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PREFACE 



This Manual is the output of a Regional Training 
Workshop on Evaluative Research in Population Education 
which was organized by the Unesco Regional Office for 
Education in Asia and the Pacific in Manila from 20 to 
31 May 1985. 

The Manual is a simplistic presentation of the 
very basics of monitoring, evaluation and evaluative 
research as applied to population education. It is 
a Manual for beginners, which the participants in the 
Regional Training Workshop feel would be immediately 
useful to project staff charged with the responsibility 
of monitoring, evaluation and research. 

The evaluative research designs cum instruments 
(i.e. questionnaires, interview schedules and tests), 
and data analysis techniques were developed in about 
ten days. Besides, by and large, the participants were 
amateurs in evaluative research. Hence, the evaluative 
research designs developed are far from sophisticated. 
However, these are the kind of evaluative researches 
which the participants feel are urgently and immediately 
needed, and those which most of them could easily cope 
with. 

The Manual represents an initial step towards at- 
tempts to assess not only the outputs of population edu- 
cation programmes, but also effects and impact. 
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Chapter One 



MONITORING AND EVALUATION* 

Introduction, There is an advantage in discussing 
monitoring, evaluation and evaluative research separ- 
ately, as they have somewhat distinctive emphases, al- 
though they also share certain common features. All 
these call for the collection of information to make 
decisions about programmes. In the case of monitoring, 
the emphasis is mostly on the mechanics of programme 
implementation as explained more fully in the next two 
paragraphs. In evaluatioi , as the word itself implies, 
there has to be a judgement of worth. Such judgement 
could either be intuitive and subjective or objective 
and based on hard data derived from carefully planned 
research stud.^s. In the latter case, the activity is 
described as evaluative research. 

It is to be noted that the definition of monitor- 
ing and evaluation in this report may be rather limited, 
and this is mainly because of the desire of the partici- 
pants to conceptualize monitoring and evaluation in the 
context of population education programmes. 

Monitoring. To monitor a programme is to collect 
information and make decisions chiefly in relation to 
the quantitative aspects of programme implementation, 
including logistics. A programme plan is pre-requisite 
for monitoring, since it is the implementation of the 
plan that is monitored. Monitoring begins with the 
commencement of plan implementation and continues 
throughoat the duration of the implementation. Evalua- 
tion and evaluative research on the other hand could 



♦Based on the lecture presentation of Prof. J.E. Jayasuriya. Resource 
Person of the Regional Training Workshop on Evaluative Research in 
Population Education, in Manila from 20 to 31 May 1985. 
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begin before a programme plan is drawn up, so that the 
insights derived from them are inputs into the planning 
process. Moreover, both can continue after the imple- 
mentation has been completed. 

Two functions of monitoring are (i) the ascer- 
tainment of information as to whether implementation is 
going on as planned; and (ii) decision making. These 
decisions will relate, inter alia, to the exploration 
of ways and means of overcoming any problems that arise 
in implementation, changes or adjustments (e.g. in cost 
estimates, time schedules), or even to the introduction 
of new inputs that are needed. A programme plan is by 
no means a Procrustean bed. Programme plans should be 
regarded as being modifiable, wlen there are sound and 
weighty reasons for doing so. Two uses of monitoring 
are implicit in what has already been stated here. 
Certain other uses may, however, be mentioned. Many 
education programmes are of a pilot nature, and if wider 
diffusion is envisaged, valuable insights may be gained 
from the monitoring of the pil >t programme, and these 
would be very suggestive in planning the diffusion. 
Often, a programme cycle has to be followed by one or 
more programme cycles, and in this case the monitoring 
of the first programme would give useful insights for 
plaining the subsequent programme cycles. Finally and 
quite importantly, monitoring is essential for discharg- 
ing the function of accountability, whether it be to 
internal authorities or to external authorities. 

Most programme plans have the "allowing items: 

1. The probl, m(s) for the solution of which the 
programme is being undertaken. 

2. The objectives of the programme. 

3. Programme coverage. 
A. Programme strategies. 

5. Administrative and supervisory structure of 
the educational system insofar as it has a 
bearing on the programme. 
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6. Programme inputs: 

a) financial; 

b) personnel; 

c ) equipment ; 

d) materials. 

7. Programme processes: 

a) research studies; 

b) preparation of instructional/training 
materials for: 

i) trainers ; 
ii) teachers; 
iii) learners . 

c) delivery of programmes to: 

i) trainers ; 
ii ) teachers ; 
iii) learners. 

8. Monitoring and evaluation. 

Not all of the above come within the scope of 
monitoring and only those which lend themselves to moni- 
toring will be discussed here. From the standpoint 
of monitoring, programme coverage provides a good item 
with which to start. By programme coverge in this con- 
text is meant the target population to which the pro- 
gramme is to be offered. In general, the target popula- 
tion will consist of trainers of teachers, teachers and 
learners. The last named are the ultimate recipients, 
while the other two categories are intermediaries. 
Depending on the locations, numbers educational levels 
and other particulars regarding the learners to be 
reached (the plan will specify them), the locations, 
numbers and categories of the teachers to be reached 
will be specified in the plan, and depending on these 
in turn there will be an identification of che trainers 
of the teachers. While trainers, teachers and learners 
are the actual programme targets, programme plans recog- 
nize the need to provide some orientation to politicians, 
media personnel, educational administrators and person- 
nel higher than or equal in level to the trainers in 
order to sensitize them to the importance of the 
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programme and get their support for implementing it. 
Thus, the target population may be described in terms 
of those who need orientation, and those who need 
training/instruction. Programme coverage has to be 
monitored so that shortfalls in locations, numbers, 
categories and time schedules are noted, and remedial 
action promptly taken. It is specially important to 
identify whether any segments or individuals of the 
intended population have not been reached, and how this 
could be set right • 

It is of value to monitor programme strategies 
to ensure that they are workable. For example, a strat- 
egy to reach school-children may be through the incor- 
poration of population content in certain subjects which 
they study in school. Monitoring will show whether 
this strategy is feasible, and if it is not feasible 
an alternative strategy has to be used. To give an 
example from the non-formal sector, the strategy in 
the plan may be the use of a literacy programme to 
convey population content, but if it is found that the 
literacy programme does not attract a sufficient number 
of learners, the use of another strategy will have to 
be considered. 

Any new educational programme has to be implemented 
within the administrative and supervisory structure 
in operation in the educational system of the country 
concerned. This structure could be supportive, indiffer- 
ent, or inimical either in its totality or in certain 
identifiable aspects or among certain persons. It is 
an important function of monitoring to ascertain the 
reactions of administrators and supervisors to the pro- 
gramme. If all or any of them are indifferent or inimi- 
cal, ways and means of making them supportive have to 
be considered. IT many are already supportive, perhaps 
the support could be even more enhanced. Another 
item to be monitored is the presence or absence of link- 
ages, as the presence of certain essential linkages 
could strengthen the implementation of the programme. 
For example, if one unit of the Ministry of Education 
is preparing a curriculum for the new programme, and 
there is another unit undertaking the revision of text- 
books, the implementation of the new programme will be 
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facilitated or hindered according to the presence or 
the absence of mutually supportive linkages. 

Ihe monitoring of financial inputs can show whether 
the funding envisaged in the plan is forthcoming, whether 
the amounts earmarked for various items of expenditure 
are released without any reductions and at the times 
specified in the plan. The project management staff 
for their part should spend the money according to the 
plan and should not divert it, wholly or partly, for 
other purposes. Monitoring should ensure that these 
conditions are observed, and take note of any departures 
f^om them, and of the reasons for such departures. 
Vmere the reasons are not sufficiently convincing, any 
similar deviation in the future from the plan should be 
discouraged. Monitoring will also take note of any 
bottlenecks in the financial processes and recommend 
remedial action. It is also one of the uses of monitor- 
ing to examine the case for an increase/decrease in the 
total allocation, or the allocation for a particular 
component, and the need, should it arise, for transfer 
of funds from one item to another. 

The programme plan will specify the inputs of 
personnel envisaged as being needed to implement the 
programme, at what points of time and for how long they 
should be in position. Any departures from the plan 
should be identified through monitoring and the reasons 
for them gone into. If such departures are ben' icial, 
the original plan may be changed to accommodate them, 
but if they are not beneficial insistence on following 
the plan without deviation from it would be necessary. 
Plans us -illy envisage that when a position is filled 
for a certain period, one and the same person will hold 
the post unless otherwise provided in the plan. One 
task of monitoring is to ensure that there is no turn- 
over of programme personnel, or that it is reduced to 
a minimum, as such turnover could be an impediment to 
effective implementation. It is necessary to make ref- 
erence here als to the fact that if the programme plan 
envisages that certain full time staff would be in pos- 
ition, this requirement should be strictly complied 
with. A programme can scarcely progress as planned, 
if programme personnel who are expected to devote their 
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full time to it do not comply with this requirement. 
It sometimes happens that certain personnel needs are 
overlooked in the plan. For example, the need for a 
financial assistant to receive and disburse money may 
not have been envisaged at the programme planning stage 
because the volume of work involved in the management 
of funds was underestimated. Or, the need for a tech- 
nician to operate equipment and keep it in good condi- 
tion may not have been envisaged. Another fact to be 
taken note of is the occurrence of bottlenecks resulting 
from an insufficiency )f certain categories of person- 
nel. For example, the number of typists may not be 
sufficient to cope with the outputs of the professional 
staff. These and a variety of other problems may come 
to the surface during the process of monitoring, and 
if this happens immediate action can follow to set them 
right. 

The equipment and materials needed for programme 
implementation will be stated in the plan. They should 
be supplied strictly according to the specifications 
(e.g. make and model numbers of a copying machine or 
a typewriter) and the time schedule mentioned in the 
plan, which means that the orders '"ill have to be placed 
sufficiently ahead. Monitoring should show the extent 
to which these requirements are taken into account. It 
is presumed that in making specifications at the plan- 
ning stage, care was taken to ensure that repair facili- 
cies and spare parts for equipment are readily avail- 
able. If monitoring shows that this is not the case, 
serious consideration should be paid to the action that 
mishl be caken to meet this problem. Furthermore, the 
purchase of equipment during the regaining period of 
the programme should be reviewed with due regard to 
the need to ensure that repair facilities and spare 
parts are available. It should also be one of the res- 
ponsibilities of the exercise of monitoring to ensure 
that equipment purchased for the programme is not di- 
verted to other programmes. 

The programme plan will provide for certain re- 
search studies to be carried out partly to support 
curriculum and instructional materials development , 
and partly to support the delivery of programmes to 
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trainers of teachers, teachers and learners. There 
will also be a time schedule for the research studies. 
The research studies should be carried out as planned 
both in regard to their scope and to their timing. If 
the studies are more limited in scope than at first 
planned, the data from them will be less than compre- 
hensive; and if they are carried out much later than 
the time for which they were planned, the data may come 
too late to be used for the intended purposes. Monitor- 
ing should take care of these dangers, and also ensure 
that usable research findings are in fact utilized for 
programme development. 

The programme plan will provide for the preparation 
of instructional and training materials for trainers 
of teachers and teachers and instructional materials 
for learners. Materials should be prepared, reviewed, 
field-tested, revised and made available to the intended 
users in time. By programme delivery tc trainers of 
teachers is meant the training of trainers of teachers. 
Such training may include periods of training/internship 
programmes/observation abroad, and certain training ac- 
tivities carried out within the country itself. Trainers 
have, in turn, to provide training to teachers through 
the use of face-to-face methods or self-instructional 
methods, so that the teachers, in turn, may provide 
instruction to learners, be they in the formal system 
or out-of-school. The progress of these activities, 
all of which are interconnected, needs careful monitor- 
ing to identify avoidable and unjustifiable departures 
from what was planned both in regard to modalities and 
timing. Corrective action that may become necessary 
should be decided upon and undertaken as expeditiously 
as possible- 

From the foregoing account, it should be clear 
that the need for monitoring, based on a comprehensive 
information system, cannot be over-emphasized. Some 
of the data needed for monitoring can be collected as 
a matter of routine by the requirement that certain 
information should be regularly provided by the various 
units and individuals engaged in programme ir plementa- 
tion. Certain kind? of data m*/ be collected on a small 
scale by interviews, questionnaires or site visits. 
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While there is unanimity on the value of monitoring 
programme implementation, a difference of opinion exists 
as to whether monitoring should be an entirely internal 
affair undertaken exclusively by the programme staff, 
or whether there should be a certain amount of monitor- 
ing by one or more persons not belonging to the pro- 
gramme staff and selected from within or outside the 
country. The balance of opinion ;eems to be that while 
the day-to-day monitoring should be carried out by the 
programme staff and those specially engaged to oversee 
the programme, a view of the programme from outside 
at least once in two or three years would be of consider- 
able value. 

Evaluation. Evaluation is the process of making 
judgements of worth and decisions on the basis of infor- 
mation collected for these purposes. Among several 
models of evaluation suggested in the literature on 
evaluation, the ensuing discussion takes as its frame- 
work a model that distinguishes four categories, namely: 
context evaluation, input evaluation, process evaluation 
and product evaluation spelling out for each category 
its objectives, methods, and relationship to decision- 
making in the various phases of programme planning and 
implementation.* Within that framework, however, the 
presentation made below is eclectic in the sense that 
on certain matters of detail there are departures from 
the analysis envisaged in the model. 

It is useful at the very outset to draw a distinc- 
tion between formative and summative evaluation. Forma- 
tive evaluation focuses on the design and operational 
components of a programme, gathering data and making 
judgements of worth about them with a view to arriving 
at decisions for effecting improvements as the programme 
moves along. Thus, the thrust of formative evaluation 
is to identify strengths and weaknesses, and arrive 
at decisions regarding the use of appropriate alterna- 
tives for improving the programme by maximizing the 
strengths and reducing the weaknesses. Summative evalu- 
ation focuses on outcomes or impact per se, assessing 
these as high or low with a view to making decisions as 
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to whether the programme is useful or not, and whether 
the programme should be continued or not. The results 
of certain assessments could be used either formatively 
cr summatively. An assessment such as the marks obtained 
on an achievement test is used formatively when the 
analysis of the data and a review of antecedent processes 
(e.g. the teaching) lead to decisions regarding the 
changes to be made in programme processes to improve 
achievement; the assessment is used summatively when 
no such analysis or review is undertaken and the judge- 
ment made is whether performance is good or bad, leading 
to a decision as to whether the programme is useful or 
not. Basically, the distinction lies in the uses to 
which the judgements of worth based on the assembled 
data are put. Certain kinds of data are useful for 
both formative evaluation and summative evaluation, 
while certain others may be more useful for one or the 
other. It follows that depending on the purpose of 
the evaluation - summative or formative - one can decide 
on the kinds of data to be collected. 

Context evaluation * The starting point for con- 
text evaluation is a situational analysis in which the 
need is identified for an observed condition that pre- 
vails at present to be transformed into a more desirable 
condition in the future. For example, the quality of 
life of the mass of people in the countries of the Third 
World is far from satisfactory, and there is an urgent 
need to impr e it. The first is the present condition 
and the second signifies the desired condition for the 
future. Many governments, recognizing that rapid 
population growth stands in the way of attaining a high 
quality of life have, inter alia* put their faith in 
population education as an educational intervention 
that might, in the course of time, lead to responsible 
parenthood and modest reproductive behaviouir, resulting 
in an improvement in the quality of life. The problem, 
the need, and the nature of the intervention having been 
thus identified, context evaluation will assess the 
acceptability of such an educational programme to the 
community, and the feasibility of itc 4 -r.troduct^n -into 
the school system and ncn-formal education. Assuming 
that acceptability and feasibility have a high prob- 
ability of being assured, steps are taken to make 
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preliminary assessments of the objectives, strategies, 
administrative structure, inputs and processes necessary 
for a population education programme; to weigh alterna- 
tives in these respects, and incorporate the decisions 
taken in a programme plan with an appropriate time 
schedule. Context evaluation may therefore be regarded 
as pre-planning evaluation culminating in the preparation 
of a programme plan. 

Input evaluation . Input evaluation concerns it- 
self with the evaluation of programme inputs. In general, 
they are the administrative structure within which the 
programme is implemented and such inputs as finance, 
personnel, equipment and materials. While monitoring 
will identify departures from the programme plan, it 
is the task of evaluation to make qualitative assess- 
ments. Personnel, equipment, and materials lend them- 
selves t such assessments. The questions to be asked 
are, for example, whether the personnel are qualified 
and competent, and whether the equipment and materials 
are the most appropriate for carrying out programme ac- 
tivities. Relevant data about them have to be collected 
and judgements of worth brought to bear upon the data. 
Decisions, if any, for change in the interests of more 
effective programme implementation will come partly 
from monitoring, partly from evaluation and partly from 
both. 

Process evaluation . Process evaluation has an 
extensive coverage, necessitating the making of judge- 
ments of worth about curriculum materials, training 
activities, teaching-learning processes, and decision 
making following upon these judgements. 

Curriculum materials may be evaluated in regard 
to such aspects as (i) their relevance to the needs 
of learners; (ii) their suitability for the age, abili- 
ty, and experience of learners; (iii) their coverage 
of population related topics; (iv) their coverage of 
the cognitive, affective and skills domains; (v) their 
relevance and likely contribution to the achievement 
of programme objectives; (vi) their sequencing and 
how they fit into the rest of the curriculum; (vii) the 
extent and nature of learner participation they envi- 
sage; and (viii) the teaching methodologies to which 
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they lend themselves. The evaluation of curriculum 
materials will be very largely formative. 

The evaluation of training should be carried out 
firstly, to determine the extent to which the objectives 
set for the trainees (namely; acquisition of the know- 
ledge base for teaching population content, acquisition 
of attitudes and values reflecting concern for quality 
of life and responsible parenthood, acquisition and 
practice of teaching skills emphasizing problem solving, 
inquiry processes, and value clarification, the acqui- 
rJ tion of skills in monitoring and evaluation) have 
been achieved, secondly, to identify improvements that 
could be effected in the training itself, and thirdly, 
to test out th2 relative effectiveness of various mo- 
dalities of teacher training. 

Three stages may be identified in the evaluation 
of training. These are the following: 

1. pre-training evaluation which includes (i) the 
collection of baseline data about the know- 
ledge, attitudes, and skills of the trainees; 
and (ii) the analysis of their training needs 
and of the organizational requirements of 

the training; 

2. in-training evaluation which includes the 
continuous assessment of the various training 
activities as they proceed in order to effect 
improvements in them for the more successful 
achievement by the trainees of the objectives 
set for them; and 

3. post-training evaluation to determine the 
extent to which the objectives have been 
achieved, the relevant criteria being the 
changes which the trainees show in their know- 
ledge and attitudes and the professional skills 
which they display in teaching learners. 

It will be noted from the foregoing account, that 
the evaluation of training will have quite strong forma- 
tive emphases as well as summative emphases. 
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In connection with the evaluation of teaching- 
learning processes, it is useful to note that in an 
educational setting learning takes place through inter- 
action (i) between teachers and learners; (ii) between 
learners and instructional materials; and (iii) between 
learners. Teacher-learner interaction has to be evalu- 
ated regarding the extent to which it promotes knowledge 
and understanding, provides a setting for the develop- 
ment of responsible attitudes and values, and encourages 
the exercise of problem-solving skills, inquiry skills, 
values clarification to the evaluation of curriculum 
materials and further elaborations is not needed here. 
As far as learner-learner interaction is concerned, 
it is best exemplified in group work, a group being 
defined as consisting of two or more persons. Learner- 
learner interaction is important not so much for the 
transfer of knowledge, but attitudes and values which 
are often caught from peers rather than taught by 
teachers, and also for the practice of problem-solving, 
inquiry and values clarification skills through gorup 
activities. All these lend themselves to both formative 
and summative evaluation. 

Product evaluation . Product evaluatioin is by 
and large concerned with the evaluation of learning 
outcomes. The nature and objectives of a programme 
of population education are such that Benjamin Bloom's 
classification into the cognitive, affective and psycho- 
motor domains needs suplement ation by the recognition 
of a skills domain to incorporate problem-solving skills, 
inquiry skills and values clarification skills, which 
need to be developed in both teachers and learners. 
The evaluation of learning outcomes throws light on 
the learners, the teaching-learning processes, and even 
the objectives of the programme, and the findings may 
be used for formative or summative purposes. 

Programme effects and impact . In the lQSO's there 
has been increasing concern on the effects and impact 
of population education programme. However, there are 
conflicting views on the definition of programme effects 
and impact. An operational definition which emerged 
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from actual problems in evaluating population education 
programmes in countries of the region is suggested in 



In Asia and the Pacific region, evaluation is 
built-in as one of the major activities of country pro- 
jects in population education. However, the usual indi- 
cators of success are the project outputs* namely; 
(i) the variety and number of teacher's guides, supple- 
mentary readers, resource books, textbooks, field workers 
manuals, posters charts, slide and tape sets, etc. which 
are produced; and (ii) the number of educators provided 
orientation, teachers and field workers trained, and the 
students and out-of-school youth and adults taught popu- 
lation education. In the chart below, emphasis has 
been placed on citing achievements regarding items in 
columns 2 (process) and 3 (output). These are basically 
assessment of efforts and outputs vis-a-vis the evalu- 
ation of effects (column A) and impact (column 5) of 
the programme. One scholar likens the evaluation of 
efforts to counting the number of times a bird flaps 
its wings, rather than measuring whe distance covered. 

Evaluation of effort and output, of course, needs 
to be done. These form parts of what has been referred 
to earlier as formative evaluation. In formative evalu- 
ation potential problem areas are identified and better 
programme implementation schemes are instituted to en- 
henace programme efficiency and effectiveness. But it 
is certainly not enough. To ascertain programme effects 
and impact systematic evaluative research need to be 
done. Evaluative research is dealt with in Chapter Two. 



1/ Based on Or. Leonardo de la Cruz, "Evaluative Research De- 
sign in Population Education" . Reference paper presented 
in the Unesco Regional Training Workshop on Evaluative Research 
in Population Education, Manila, 20-31 May 1985. 
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Chart 1. Evaluation of population education 
programmes • Systems approach 



Input 
(I) 


Process 
(2) 


Output 
(3) 


Effect 
(4) 


Impact 
(5) 


- Profes- 
sional Ex- 
pertise of 
Staff 


- Planning 
and Manage- 
ment 


- National/ 
Regional 
Plans/ 
Projects 


- Planning 
Management 
Competencies 


Fertility 
Behaviour 


- Adminis- 
trative 
Support 
Staff 


- Curricu- 
lum and Ma- 
terials De- 
velopment 


- Curricula 
Materials 
Developed 


- Knoweldge 
and Atti- 
tude of 
Officials 


Economic 
Status 


- Govern- 
ment 
Budget 


- Training 


- School Of- 
ficials/ 
Teachers/ 
Other Per- 
sonnel 
Trained 


- Knowledge, - 
Altitudes, 
Skills 
(Teaching/ 
Learning) of 
Trainers and 
Teachers 


Other 
Changes in 
Quality of 
Life 


- UNFPA 
Funding 
Support 


- Research 
and Eva- 
luation 


- Completed 
Researches 


- Knowledge, 
Attitude, 
Practice, 
Skills of 
Students and 

Fiftlrl Wnrkeirq 

f lOlU FVUI nDI 9 




- Other 
Funding 










- Unesco's 
Technical 
Assistance 


- Documenta- 
tion 


- Materials 
Collected, 
Analysed 
and Dis- 
seminated 


- Knowledge, 
Attitude, 
Skills of 
Curriculum 
Writers 





Conclusion . Monitoring, evaluation and evaluative 
research are essential elements in the planning and impl 
mentation of any programme to ensure that the programme 
is attaining its objectives as efficiently and as eco- 
nomically as possible without any undesirable side 
effects. This manual together with earlier publication 
Manual on Evaluation in Population Education (Bangkok, 
1979) should provide an introductory knowledge base 
for undertaking these activities in the countries which 
have embarked on programmes of population education. 
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EVALUATIVE RESEARCH DESIGNS: KNOWLEDGE BASE* 



Designs of Research 

Research design is the plan, structure and strat- 
egy of investigation conceived so as to obtain answers 
to research questions and to control variance. 

An evaluative design spells out how an evaluation 
research will be done, i.e. what groups will be studied; 
when and how data will be collected, how these would 
be analyzed. The design tells the investigator, in 
effect, "Do this and this; don't do that or that; be 
careful with this; ignore this, and so on". It is the 
blueprint of the research architect and engineer. 

Research design has two basic purposes, namely 

(i) to provide answers to research questions; and 

(ii) to control variance. 

In experimental research, "control" of variance 
means: (i) controlling the variance of the extraneous 
or "unwanted" variables that may have an effect on the 
experimental outcomes; and (ii) minimizing the error 
or random variance, including errors of measurement. 

The key questions, which evaluative research seeks 
to answer are: How effective is the treatment /inter- 
vention introduced? Does it produce a significant dif- 
ference from what results without the treatment of inter- 
vention? Does it effect a significant gain in knowledge, 
a change in attitude or changes in behaviour? What 
is its overall impact? 



*Based on the lecture presentation of Dr. Milagros D. Ibe, Professor, 
College of Education, University of the Philippines, consultant of 
the Regional Training Workshop on Evaluative Research in Population 
Education in Manila, from 20 to 31 May 1985. 
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Diagrammatically , this is illustrated in the fol- 
lowing figure: 



Does 



programme/ 
intervention 



lead to 



change in 

knowledge 
attitude 
practice? 




E xperimental designs . Experimental research de- 
signs which may be used for evaluating the effects or 
impact of population education programmes can be cat- 
egorized into three main groupings, namely (i) non- 
experimental; (ii) experimental; and (iii) quasi- 
experimental designs. Non-experimental designs are 
sometimes referred to as pre-experimental designs be- 
cause they fail to meet the criteria of true experiments. 
Kerlinger (1976) refers to them as inadequate designs. 
At best, they give descriptive information about the 
programme since measured f, effects" cannot be firmly 
attributed to the intervention or treatment. 

Quasi-experimental designs also fail to uieet all 
the criteria for true experiments because they do not 
use randomization. However, they provide a close 
approximation to experimental designs and are definitely 
better than the non-experimental designs. Randomization 
is not always feasible; it is sometimes a costly and 
tedious process. 

Pre-experimental designs . In the context of popu- 
lation education, these designs provide descriptive 
information about outcomes of the programme but do not 
enable the evaluator to firmly ascribe these to the 
programme. 



1. 



One group post-test design. This is shown 
on the paradigm in Figure 1. The treatment, 
intervention or programme (represented by X) 
is given to a group. After a period of time, 
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say six months or a year, an observation (0) 
is made. The observation may be done through 
a knowledge test, an attitude inventory or a 
behaviour observation checklist to determine 
effects of the treatment (X) on the knowledge, 
attitude and behaviour respectively of the 
group. 

Figure 1 

Time ^ 
X 0 



This design suffers from major weaknesses. 
Since there is no pretest (or initial measure), 
it is not possible to determine the extent 
of change effected by the treatment. Moreover, 
the design does not provide for a control 
group against which the post-test measure of 
the group studied can be compared. 

One group prestest-post-test design* This 
design (Figure 2) is an improvement over the 
first design (Figure 1) in that there is a 
pretest or initial measure on which to base 
change or gain. However, since there is no 
control group for comparison purposes, the 
user of this design cannot firmly say that 
the gain or change observed from pretest to 
post-test is not due only to effects of history, 
maturation or testing. 

Figure 2 

Time 
0l X 0 2 



Different pretest group. This design provides 
for a pretest and a post-test, but these are 
administered to different groups. For example, 
the pretest is given to a group. Then the 
programme or intervention is given to another 
group. The latter group is administered a 
post-test, which is compared to thv pretest 
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measure of the other group. This design, 
which i& shown in Figure 3, attempts to com- 
pare tha post-test measure with an initial 
measure from another group, the implicit 
assumption being that a similar pretest measure 
would have been obtained had the group given 
the treatment been given the pretest as well. 
Itowever, since it is an altogether different 
group, the assumption may be untenable. Hence, 
even if O2 is significantly higher than 0^, 
the difference may not be firmly attributable 
to the treatment X. 

Figure 3 
Time 

°1 



A. Static group comparison. In this design, a 
control or comparison group is introduced 
(Figure A). Both groups are given a post- 
test although no treatment is given to the 
control group. 

Figure A 

Time y 

Experimental Group X 0^ 
Control Group O2 



Since no pretest is made, the initial 
standing of the two groups is not known. No 
attempt is made to make them initially compar- 
able or to match them. It is possible that 
differences noted between 0^ and O2 are due 
to initial differences between the two groups. 
It is also possible that whatever edge the 
experimental group has over the control group 
is due mainly to the Hawthorne effect!/ and 
not really due to the treatment or interven- 
tion X. 

1/ "Hawthorne effect" is the tendency of subjects to perform well 
because they know that they ore being studied or observed. 
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Experimental designs . In the designs under this 
category, variances due to extraneous are controlled 
through random selection of subjects and random assign- 
ment of groups to treatments. 

5. Post-test control group design. Two groups - 
a control and an experimental group - are 
randomly (R) constituted and assigned to the 
treatments (X and ^X) and given the same post- 
test after a time. 

It is assumed that the random selection 
of the subjects in each group has controlled 
all variables which might have an effect on 
the outcomes. If a pretest will tend to affect 
the post-test, this design is preferred over 
the next design. However, there is still the 
possibility that a significant difference 
between 0^ and O2 is due mainly or in part to 
initial differences between thf> two groups. 



Figure 5 






Time 


(R) 


Experimental Group 


X o 1 


(R) 


Control Group 


- X 0 2 



It is to be noted that the control group 
need not be a case o r absence of treatment. 
Treatment of another type (i.e.-X) could be 
the control vis a via a particular treatment 
(e.g. X); and the effects of the latter can 
be compared to the effects of no treatment (NX). 

6. Pre teat-post- test control group design. This 
design is the classical experimental design. 
It is ideal, though not always feasible. It 
avoids th3 weaknesses of the previous designs 
because it uses randomization, i comparison 
group, and a pretest (figure While there 

may be practice test effects the post-test, 
these can be detected and statistically con- 
trolled. 
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Figure 6 

Time 

(R) Experimental Group 0^ X O2 
(R) Control Group 0 3 -X 0 4 



It is assumed that with randomization Oi 
will not be significantly different from 03, 
If that is so, then effects of the treatment 
can be inferred if 0 2 >04 or (0 2 ~0i) XO4-O3) . 

However, if 0 X and 0 3 differ significantly, 
then the initial difference can be statisti- 
cally controlled through analysis of covariance 
uring the pretest score as a covariate. 

7. Multiple treatment^ post-test only design. 
In this design (Figure 7) more than one ex- 
perimental treatment is compared with a control 
treatment. It is like repeating the design 
(Figure 5) several times over, but using the 
same control group each time. No pretest is 
used, on the assumption that the randomization 
controls all extraneous variables. This design 
is appropriate for studying, say, the relative 
effects of different methods of delivering 
population education. 



Figure 7 




Time 




(R) 




V 


(R) 


*2 


o 2 


(R) 


x : 


o 3 


(R) 


-X4 


04 



8. Multiple group* alternate pretest-post-vest 
design. This design combines those designs 
in Figures 5 and 6, and hence calls for four 
groups. It is sometimes called the Solomon 
Four-Group Design. With it, practice effects 
(if any) of testing can be observed. From 
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Experimental designs . In the designs under this 
category, variances due to extraneous are controlled 
through random selection of subjects and random assign- 
ment of groups to treatments • 

5. Post-test control group design, Tvo groups - 
a control and an experimental gro\p - are 
randomly (R) constituted and assigned to the 
treatments (X and ^X) and given the same post- 
test after a time. 



It is assumed that the random selection 
of the subjects in each group has controlled 
all variables which might have an effect on 
the outcomes. If a pretest will tend to affect 
the post-test, this design is preferred over 
the next design However, there is still the 
possibility tha a significant difference 
between 0^ and O2 is due mainly or in part to 
initial differences between the two groups. 



It is to be noted that the control group 
need not be a case of absence of treatment. 
Treatment of another type (l.e.~X) could be 
the control vis a vis a particular treatment 
(e.g. X); and the effects of the latter can 
be compared to the effects of no treatment (NX), 

6. PretesL-post-test control group design. This 
design is the classical experimental design. 
It is ideal, though not always feasible. It 
avoids the weaknesses of the previous designs 
because it uses randomization, a comparison 
group, and a pretest (Figure 6). While there 
may be practice test effects on the post-test, 
these can be detected and statistically con- 
trolled. 



re 5 



(R) Experimental Group 
(R) Control Group 



Time 
X 0^ 

~ X 0 2 
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Figure 6 



Time 

(R) Experimental Group 0^ X 0 2 
(R) Control Group 0 3 -X O4 



It is assumed that with randomization 0^ 
will not be significantly different from O3. 
If that is so, then effects of the treatment 
can be inferred if 0 2 >0 4 or (0 2 -0i) XO4-O3) . 

However, if 0^ and 0 3 differ significantly, 
then the initial difference can be statisti- 
cally controlled through analysis of covariance 
using the pretest score as a covariate. 

7. Multiple treatment j post-test only design. 
In this design (Figure 7) more than one ex- 
perimental treatment is compared with a control 
treatment. It is like repeating the design 
(Figure 5) several times over, but using the 
same control group each time. No pretest is 
used, on the assumption that the randomization 
controls all extraneous variables. This design 
is appropriate for studying, say, the relative 
effects of different methods of delivering 
population education. 



8. Multiple group* alternate pretest-post-test 
design. This design combines those designs 
in Figures 5 and 6, and hence calls for four 
groups. It is sometimes called the Solomon 
Four-Group Design. With it, practice effects 
(if any) of testing can be observed. From 



Figure 7 




Time 



(R) 
(R) 
(R) 
(R) 
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the four groups, effects of the treatment X 
can be firmly inferred. 

Figure 8 







Time 




(R) 


Ol 


X 




(R) 


0 3 


- X 


04 


(R) 




X 


05 


(R) 




-X 


o 6 



Some of the relationships which may be 
expected are: 



0 2 > 0 1 
0 4 > 0 3 

01 > O3 

0 2 > O4 

(0 2 -0 1 )>(04-0 3 ) 
O4 > o 6 
0 2 > 0 5 



effects of X 

possible practice effects 

inlt-i^l rnmnarabilitv of 
the two groups 

confirmation of effects of X 

effects of X 

effects of X 

practice affects 

practice effects 



On the whole, however, our concern will 
be focused on the effects of the treatment X. 

Quasi-experimental designs . Because randomization 
is not always feasible, researchers use alternative de- 
signs which do not demand randomization. Instead of 
randomized groups, matched groups are used; or a group 
is compared to itself. The designs used are quasi- 
experimental, and include the following: 

9. Time series design. This is an improvement 
of Design No. 2 because instead of one obser- 
vation before and one observation after the 
treatment X, several observations are made 
before and after X. This is shown in 
Figure 9 as on the following page. 
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Figure 9 



10. 



11, 



12, 



Time 



°2 °3 



0 A 0 5 0 6 



The group is compared to itself. The use 
of the design in Figure 9 makes it possible 
to separate the reactive measurement effects 
from the effects of X. 

Non-equivalent group design. This is an ap- 
proximation of the true experimental design, 
but without randomization. An attempt is 
made to make the groups initially comparable. 

Figure 10 



Time 



Experimental Group 
Control Group 



0 3 -X 



0 2 
0 A 



Three-group design. This design involves 
giving three groups a pretest at the same 
time. The groups are exposed to the treatment 
X at different times. A post-test is given 
at the end of the treatment. The post-test 
is also given to one of the two other groups 
to provide a comparison measure. Each of the 
two other groups takes two post-tests. (See 
Figure 11) 

Figure 11 







Time y 


Group 


I 


0 l X 0 2 


Group 


II 


o 3 o 4 X o 5 


Group 


III 


o 6 o 7 X 0 8 



A variant of the four group design. No ran- 
domization is required in this design. A 
delayed post-test is given to two of the groups, 
as shown in Figure 12 on the following page. 
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Figure 12 







Time 




Group 


I 


o 1 X 


0 2 


> 


Group 


II 


0 3 -X 






Group 


III 


X 






Group 


IV 


-X 




°6 



Internal and external validity 

Earlier, it was said that the purpose of research 
design is to control variance to ascertain the internal 
validity of the research. Internal validity asks this 
question: "Did X, the experimental treatment, really 
make a significant difference?" Anything affecting 
the controls of a design becomes a problem of internal 
validity. 

What are the criteria for a research design? 
The main criterion can be expressed in this question; 
"Does the design answer the research question?" or "Does 
the design adequately test the hypotheses?" The second 
criterion is control of independent and extraneous vari- 
ables. To do this, it is best to randomize whenever 
possible, i.e. select subjects at random; assign subjects 
to groups at random; assign experimental treatments to 
groups at random. The third criterion is generalize 
ability. It means, "Can we generalize the results of 
a study to other subjects, other groups and other condi- 
tions? How much can we generalize the results of the 
study? To whom or what can we generalize the results?" 
This third criterion is concerned with external validity 
or representativeness. 

Campbell and Stanley*/ cite the following factors 
as threats to internal validity: 

1. History > this refers to events which happen 
during an experiment or the implementation 
of a programme, which tend to influence its 
effects . 



2/ Donald T. Campbell and Julian L. Stanley's Experimental and 
Quasi-Experimental Design and Quasi-Experimental 
Design for Research. [Chicago, Rand McNally College and 
Publishing Co. 1979). 

23 

3j 



Evaluative research in population education 



2. Selection, this refers to the bias introduced 
in the choice of subjects or the sample (e.g. 
taking subjects who volunteer or are pre- 
identified on the basis of a variable related 
to the dependent variable). 

3. Instrumentation, this refers to the effect of 
research tools (as in the use of a different 
pretest and post-test instrument, or a ques- 
tionnaire which has a reactive effect on the 
subjects) . 

4. Testing, this refers to the practice or reac- 
tive effect of a pretest on the post-test. 

5. Maturation, this refers to change in the sub- 
jects over time, which is developmental change. 
For example, a pretest-post-test gain in weight 
may not be due to the diet introduced but 

to natural growth of the subjects. 

6. Mortality, this refers to drop-out, loss or 
attrition of subjects during the study. For 
example, the low ability subjects may drop 
out from the experimental group, and as a 
consequence the post-test mean score is higher 
than what it would have been if the low ability 
members had stayed on. 

7. Measurement, this refers to the influence of 
the assessment procedure. For example, the 
post-test results may be due mainly to in- 
crease sensitization due to the pretest and 
not to the experimental treatment. Contro- 
versial attitudes, for instance, seem to be 
especially susceptible to such sensitization. 

8. Regression, this refers to a statistical 
phenomenon whereby scores on a pretest regress 
toward the mean, i.e. lower scores on the 
pretest tend to be higher, and higher scores 
lower on the post-test, when in fact no real 
change has taken place in the dependent 
variable . 



9 

ERLC 



24 

34 



Evaluative research designs 



Control of extraneous variables . Control of 
variance include minimizing, nullifying or isolating 
the influence of extraneous variables, i.e. independent 
variables which are not part of the study. 

There are five ways to control an extraneous 
variable: 

1. Eliminate the variable. To do this, the re- 
searcher can choose subjects so that they are 
as homogeneous as possible on that variable. 

2. Randomize. Theoretically, randomization is 
the only method of controlling all possible 
extraneous variables. 

3. Build the variable into the design. This 
means building it in as an attribute variable, 
thus achieving control and yielding additional 
research information about the effect of the 
variable on the dependent variable and about 
its possible interaction with other indepen- 
dent variables. 

A. Match subjects. This is similar in principle 
to building the variable into the design. 
Matching has limitations however. The vari- 
able on which the subjects are matched must 
be substantially related to the dependent 
variable, or the matching is a waste of time. 
Matching on more than one variable leads to 
a loss of subjects. Matching of any kind 
is no substitute for randomization. If sub- 
jects are matched they should then be assigned 
to experimental groups at random. 

5. Use statistical control. Analysis of covari- 
ance can be used to control an extraneous 
variable which influences the dependent vari- 
able. For example, if the pretest scores of 
two treatment groups differ significantly, 
then the initial difference can be controlled 
by using the pretest score as a covariate 
in the analysis of difference between the 
two groups 1 post-test scores. 



9 

ERIC 



25 

3 b 



Evaluative research in population education 

On Instrumentation for Evaluating Population Education 
Programme 

Within the framework of the research design, there 
is a need to consider the instruments or data gathering 
devices for the research. For assessing knowledge or 
knowledge gain, the most common instruments are tests 
and other performance measures. Behaviour is measured 
through observation checklists or rating scales. 

For measuring attitudes, there is a wide variety 
of instruments that one can use. Among them are the 
following: 



1. 


Alternate response items. 


2. 


Rating scales. 


3. 


Likert scales. 


4. 


Open-ended questions. 


5. 


Sentence completion items. 


6. 


Ranking items. 


7. 


Observation checklists. 


8. 


Situation tests. 


9. 


Semantic differential. 


10. 


Projective techniques. 



Before going on to describe each of these different 
types of instruments, it is worthwhile reminding the re- 
searcher that instruments could have serious limitations. 
Some of the more important limitations are that instru- 
ments employed in educational measurement typically: 

a) involve an inference rather than a direct 
observation of the attribute being measured; 

b) employ arbitrary and unique scales of 
measurement ; 

c) consist of a saiaple of responses from a 
potentially unlimited set of such res- 
ponses; and 

d) reflect value Judgements which are made 
during the construction of the instrument. 

Generally, in attitudo instruments there are no 
right or wrong answers. The intent is to get an indica- 
tion of the respondents attitude through his responses. 
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Alternative-response items . These are items which 
give the respondents only two options to choose from: 

Example: 

a) If you had the freedom to choose, where would 
you prefer to live? 

in the city 

in a rural area 

b) Should population education be required in 
all schools? Yes No 

c) Should contraceptives be made available to 
all women between ages 20 to 45? 

Yes No 

Rating scales . These are structured items which 
provide answer options to the respondents. The options 
fall along a continuum. The scale could be descriptive, 
numerical, graphic or a combination of these types. 

Example: 

a) Based or your experience, how useful is a 
training course like this one? 

Graphic-descriptive : 

I I I 

Very Moderately Slightly 

useful useful useful 

Descriptive: 

Very useful 

Moderately useful 

Slightly useful 

Not at all useful. 

The above example is a 4-point rating 
scale. A 5-point scale can also be used. 

Example: 

b) How much new knowledge did you get irom 

the training programme? (circle one number) 

I I I I I 

0 1 2 3 A 
None at all Very much 
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The descriptive scale options can be 
written as follows: 

Very much 

Much 

Moderately 

Little 

None at all 

When several items using the same descrip- 
tive scale are put together, the scale points 
can be placed as column headings and the 
respondent simply checks (J) the column cor- 
responding to his answer to each item, 

Likert Scale items . These are statements to which 
the respondent is asked to indicate agreement or dis- 
agreement, or if he is undecided/neutral. Five-point 
Likert Scales involve a range of responses ranging from 
"Strongly Disagree" to "Strongly Agree" with "undecided" 
as the middle point. 

Sample Likert Scale items. Circle the letter 
which matches the extent of your agreement or disagree- 
ment with each of the following statements. The letters 
have these meanings: 



SA 


Strongly agree 


A 


Agree 


U 


Uncertain 


D 


Disagree 


SD 


- Strongly disagree 



Begin here: 

1. A male first born child brings luck to the 
family, 

SA A U* D SD 

2. Families with more than four children are 
happier than families with only one or two 
children, 

SA A U D SD 

3. If only one child is allowed, it is better 
to have a son than a daughter. 

SA A U D SD 
28 
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4. If given the choice, I would prefer to live 
in the city. 

SA A U D SD 

Here are some pointers on how to write Likert 
Scale items: 

1. Use short, simple and opinionated statements. 

2. Be sure the statement conveys only one idea. 

3. Avoid using factual statements. 

4. Use statements on which opinions vary widely. 

5. Avoid using double negatives. 

6. Try to have as many negatively oriented state- 
ments as positively-oriented ones. 

7. Have at least 10 statements in the set. 

Open-ended questions . These are direct questions 
for which responses are constructed/written by the res- 
pondent. No answer options are provided. 

This type of item is used when qualitative infor- 
mation is called for. In the analysis, the responses 
can be grouped by categories, and frequences of mention 
can be reported. 

Example: 

What are peoples' reasons for preferring large 
families? 



What would be the consequences if population 
growth is allowed to continue unabated? 
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Sentence completion items . These are unfinished 
statements which the respondent is asked to complete. 
The beginning phrase or clause should stimulate the 
respondent to think. 

Examp les : 

Complete the unfinished statement by writing 
the first thought that comes to your mind: 

1. Our ancestors had large families because 



2. Having few children is advisable because 



3. When I see families with many children I feel 



A. If people are not given population education, 
they would 



5. The best time to introduce population educa- 
tion in schools is 



Ranking items . These consist of a set of homo- 
geneous items (concepts, methods, topics) which the 
respondent is asked to rank according to a specified 
criterion (for example, according to frequency of use, 
importance, effectiveness) as he perceives them. 

Examp le : 

Rank thes* training methods according to 
how effective you consider them for teaching popu- 
lation education. Write "1" for the most effec- 
tive, "2" for the next most effective, "3" for 
the next , and so on: 

Lecture 

Discussion 

Film showing 

Role playing 

Demonstration 
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Problem solving 
Field trips 

Observation of classes 
Workshops 

Other ( specify 



Ob servation checklists . These are lists of ex- 
pected behaviours which are expected to be manifested. 
The observer is asked to indicate whether or not he 
observed each of the behaviours. 

Here is a sample observation checklist for a 
lesson in population education. 



Yes No 



1. Does the teacher: 

a) state the lesson 
objectives? 

b) cite realistic examples? 

c) use appropriate visual 
aids? 

d) elicit student views? 

e) make use of students' 
ideas? 



2. Are the examples cited: 

a) relevant to the age group? 

b) linked to everyday 
problems? 

c) linked to other subjects? 

Semantic differential . This is a special type 
ol rating scale. Bi-polar descriptors are used for 
5- or 7-point scales. On each descriptive scale, the 
rater indicates with "X" the point which matches his 
rating of the concept being rated. 

Th2 respondent is asked to answer the items fast, 
instead of thinking too deeply on each concept. What 
is important is that he register his perception of the 
concept . 
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Example: 

The materials used in this training programme are: 

Diffi- 

Easy cult 

Inter- 
esting Boring 

Irre- Re- 
levant vant 

weii- Badl y 

written written 

Ille- Le- 
gible ble 

Unimpor- Impor- 
tant tant 

Situation tests . In this type of item, the stimu- 
lus is a situation which poses a problem. The respon- 
dent is asked how he will act or behave under the given 
circumstances. Sometimes the item includes structured 
options. Other times, the item is unstructured that 
is, open-ended. 

Example: 

You had been living in the city for ten years. 
On your return to your home province you could not help 
noticing the many children in your relatives' homes. 
Most of the children were not adequately clothed and 
some looked malnourished. 

What would you most likely do under the circum- 
stances? 

1. Talk to my relatives and suggest they 

consider limiting their families. 

2. Make a joke about how fast my relatives 

have increased in number. 

3. Keep quiet but silently resolve that I 

~ would not let myself have a big family 
like them. 
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4. Ignore what I observed. The number and 
condition of their children are not my 
concern. 

5. Other (specify) 



Projective techniques . In sentence completion 
and situation test items, the respondent projects himself 
and unknowingly reveals his beliefs, values and atti- 
tudes. Projective-techniques have this purpose: to 
get the respondent to unknowingly reveal thoughts, 
biases, attitudes (likes and dislikes) as he responds 
to seemingly unrelated stimulus situations. 

Examples of projective test items are the following: 

1. Draw a picture of a happy family; of an un- 
happy family. 

2. Given this picture (show a picture), what do 
you think the man/woman in the picture is 
thinking of? 

3. Write a paragraph/story telling what you think 
happened immediately before this situation 
(as shown in a picture) took place. 
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Chapter Three 
EVALUATIVE RESEARCH DESIGNS: SOME SAMPLES 

Introduction. One of the main objectives of the 
Regional Training Workshop on Evaluative Research on 
Population Education, which was organized by the Unesco 
Regional Office for Education in Asia and the Pacific 
in Manila from 20 to 31 May 1985 was "to co-operatively 
develop various evaluative research designs with accom- 
panying data gathering instruments/tools and data analy- 
sis techniques on different problem areas of population 
education. 

In view of the fact that many of the participants 
are beginners in evaluative research, and that the re- 
gional workshop was only for two weeks, the evaluative 
research designs and instruments developed are quite 
simple. The designs do not involve complicated data 
analysis techniques. By and large, the evaluative re- 
search designs developed in the Workshop are those which 
most of the participants feel they ought to do and could 
do upon their return. 

The participants of the Regional Training Workshop 
worked as two groups. The Formal Population Education 
Group (Group I, Annex A) developed three evaluative 
research designs, namely (i) a pre-experimental design 
entitled, "Determinants of Population Knowledge and 
Attitudes of Secondary School Teachers of Population 
Education"; (ii) an experimental design entitled, "The 
Relative Effectiveness of Two Techniques of Teaching 
Population Education to Secondary School Students"; 
and (iii) a quasi-experimental design entitled, "An 
Evaluation of an Innovative Approach to In-Service Train- 
ing of Middle School Teachers of Population Education". 
The evaluative researca designs together with the research 
instruments are presented on the following pages. 




Some samples 



A Pre-experlmental Design: Ex-post Facto Design 

Title: Determinants of Population Knowledge and Atti- 
tudes of Secondary School Teachers of Population 
Education 

Rationale . Some of the countries of the region 
have had population education at the secondary school 
level for more than a decade. In this context, the 
classroom teachers have been exposed to pre-service 
and in-service training programmes, as well as to curri- 
culum guides and resource materials in population educa- 
tion. The purpose of this study is to compare the 
teachers' knowledge with the knowledge expected of them 
as population education teachers. It also intends to 
find out what their attitudes are with regard to popula- 
tion issues. Since the programmes have more or less 
completed the first cycles, an ex-post facto design is 
used for the study. The study intends to determine 
which of the variables about the teachers (their charac- 
teristics, training and context variables) are related 
to and/or influencing their knowledge and attitudes 
towards population education. 

Goal and objectives . The goal of this study is 
to assess the effects of the population education pro- 
gramme on the level of knowledge and attitudinal charac- 
teristics of the secondary school teachers teaching 
population education. The specific objectives are to: 
(i) study the profile of teachers of population educa- 
tion; (ii) determine the level of knowledge in popula- 
tion education of secondary school teachers; (iii) de- 
termine their attitudes towards population education 
and population issues; (iv) compare the level of ex- 
pected knowledge with the manifested knowledge of the 
teachers; (v) identify variables which correlate with 
the teachers' knowledge and attitudes; and (vi) deter- 
mine which combination of variables can be used to pre- 
dict the teachers' knowledge and attitude scores. 

Conceptual framework . The population education 
contents which should be taught are prescribed in the 
syllabuses prepared for teaching population at the 
secondary school level. Thus the expected learning is 
very well defined. 
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However, the expected learning has to be obtained 
by teachers who vary in many attributes, among which 
are: (i) personal characteristics (sex, age, religion, 
marital status); (ii) educational attainment; (iii) pro- 
fessional attainment; (iv) teaching experience; (v) ex- 
perience in teaching population education; (vi) exposure 
to training programme in population education; (vii) ex- 
posure to resource materials; (viii) support given by 
the school administration; and (ix) supportivenoss of 
the community. 

This study assumes that a teacher's ability to 
teach population education is dependent on his/her know- 
ledge of population concepts and his/her attitudes to- 
ward population education. There are, of course, other 
determinants of the teachers' knowledge and attitudes. 
The study will test the hypothesis that some or all of 
the teacher variables listed above are determinants 
of teachers' knowledge of population concepts and atti- 
tudes toward population issues. 

The conceptual framework is diagramatically shown 

below: 



r 



Personal 
characteristics 



Expected 
knowledge 



Y 



r 



Knowledge 



Pupils 



Professional 
background 




knowledge 



and 



Attitudes 



attitudes 



J 



Environmental 
variables 



j 
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Hypotheses . Since this is an ex-post facto study 
on the effects of the programme, the teachers 1 attri- 
butes are considered independent variables. The hypoth- 
eses are that: (i) the manifest knowledge scores will 
be different from the expected knowledge scores; 
(ii) teachers 1 knowledge and attitudes are correlated 
with their personal characteristics, professional train- 
ing and environmental variables; and (iii) there is a 
combination of variables which can be used to predict 
the teachers 1 knowledge and attitude scores. 

Methodology . The design of the study is as fol- 
lows: 

where X is the Population Education Programme 
which has already been implemented. 
It is not manipulated in this study. 

Y = manifested knowledge and attitude. 

Sampling. A purposive selection will be made of 
some education districts or regions which are represen- 
tative of the country, taking into account the popula- 
tion distribution. For the purpose of the study only 
public schools which are invob ed in the population 
education programme will be chosen. The number of 
regions/districts will be srch as to ensure that the 
5 per cent sample is not more than 200. The actual 
selection will be done on a stratified random basis. 

Research instruments. The instruments of the 
study will be (i) a background data collection ques- 
tionnaire; (ii) a knowledge test of the multiple-choice 
type; and (iii) an attitude test of the Likert Scale 
type. 

Data collection and analysis. To compare scores 
of two groups on the tests of knowledge and attitude, 
the t-test will be used. The Pearson correlation tech- 
nique and chi-square analysis will be used to determine 
relationships between variables. Multiple regression 
analysis will be used to identify significant determi- 
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nants of knowledge and attitude scores. The .05 level 
of significance will be specified for all statistical 
tests. 

Expected outcomes . The study hopes to identify 
some antecedent attributes of teachers which determine 
their performance in the knowledge and attitude tests. 
(The assumption is that the teachers' performance posi- 
tively correlates with the performance of their pupils.) 

The attributes which are part of the programme, 
and which have been identified as predictors of perform- 
ance may be considered for further development. Further- 
more, the results of this study could be utilized as 
base-line data in the planning, implementation and 
evaluation of future programmes in population education. 

Instrumentation . In preparing the research instru- 
ments a table of specifications was used (Table 1). 
Likewise, after the experimental trial use of the re- 
search instruments, an item analysis table was prepared 
(Table 2). The research instruments were revised ac- 
cordingly, on the basis of the findings of the item 
analysis. The revised research instruments are on pages 
41 to 49. 
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Table 1. Specifications for knowledge questions 



Ques- 


Population 
concept 


Type of Question 


tion 
No. 


Recall 


Def ..<i- 
tion 


Appli- 
cat ion 


Calcu- 
lation 


Matching 


1. 


Population of 
country 


J 










2. 


Doubling rate 








J 




3. 


Population of some 
covin t ry 


J 








J 


4. 


Population pro- 
jection 


J 


J 








5. 


Population pyramid 






J 






0. 


Nat ional income 


J 


J 








7. 


Rate of growth 


J 


J 








8. 


Population dyna- 










J 




mics 










9. 


Consequences of 
RFG* 






J 




J 


10. 


Carrying capacity 




J 


J 






11. 


Aims of popula- 


J 












iiuii wjuca t ion 










12. 


Family planning 


J 


J 








13. 


Quality of Life 






J 






14. 


Consequences of 
RPG* 












15. 


Fertility 


J 


J 








16. 


Population Growth 






J 








economy 










17. 


Population and 


J 












food 











♦RPG means Rapid Population Growth. 
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Table 2. Item analysis 



I terns 


Response 
option (f) 


NR 


Difficulty 


High 


Low 


Discrimi- 
nation 
Coefficient 


levels (2) 


R 


W 


R 


W 




A 


B 


C 


D 


1. 


2 


11 


<4> 


o 


2 


21 


3 


5 


1 


7 


.25 


2, 






6 


o 


2 


27 


1 


5 


3 


6 


.25 


3. 


8 


© 


2 


V-/ 


1 


27 


3 


5 


1 


7 


.25 


4. 


3 




5 


3 


0 


16 


1 


7 


2 


6 


.13 


5. 


9 


5 


2 


© 


1 


11 


1 


7 


0 


8 


.13 


6. 


I 


11 




1 


3 


16 


2 


0 


1 


7 


.13 


7. 


3 


o 




2 


1 


42 


5 


3 


1 


7 


.50 


8. 


1 


9 


4 


vi/ 


1 


21 


4 


4 


0 


8 


.50 


9. 




2 


7 


4 


2 


21 


2 


6 


1 


7 


.13 


10. 


i 




4 


3 


1 


53 


5 


3 


3 


5 


.25 


11. 


l 








1 


57 


7 


0 


2 


7 


.25 


12. 


7 


1 


4 


® 


1 


32 


4 


4 


0 


8 


.30 


13. 


2 


7 




0 


0 


53 


8 


0 


1 


7 


.81 


14. 


1 


7 


® 


2 


0 


48 


4 


4 


3 


5 


.13 


15. 


7 


5 


0 




0 


27 


1 


7 


3 


5 


.25 


16. 


2 


0 


4 




1 


64 


7 


1 


3 


5 


.50 


17. 


0 


5 


1 




1 


64 


6 


2 


4 


4 


.25 


18. 


1 


13 


4 


0 


1 


69 


6 


2 


5 


3 


.13 


19. 


2 


2 


6 


CD 


1 


32 


5 


3 


1 


7 


.50 



The formula is: Difficulty - - x 100 

Where R = number of pupils who got the item right. 
T = to total number of pupils who tried to 

answer the question. 
W = number of pupils whose answers were wrong. 
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Questionnaire in Population Education 
for Secondary School Teachers 



PART I 



Directions: Please fill in the blanks or put a check 

mark U) in each item below as your answer: 

I. General information: 



1. Region 

Province 

2. Sex: □ Male 

3. Marital status: 



4. Ages: 



Division 

District/School 

□ Female 

□ Single 

□ Married 

□ Separated/Widowed 

□ 20-25 years old 

□ 26-30 years old 

□ 31-35 years old 

□ 36-40 years old 

□ 41-45 years old 

□ 46 and above 



5. Educational qualification: 



I I E.T.C. - B.S.E. 

□ B.S.E. 

□ Bachelor with MA Units 
D MAT/MA. Ed. /MA Graduate 

□ With Ph.D. Units 

□ Others (please specify) 



6. Teaching experience: 

□ 1-3 years 

□ 4-6 years 

□ 7-9 years 

□ 10-12 years 

□ 13 and above 
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7. Number of years of teaching population education: 

I I 1-3 years 
I I 4-6 years 

□ 7-9 years 

□ 10-12 years 

□ 13 and above 

8. Population education in-service training attended: 



Type of training 


Duration of 
training 


Year 
attended 


1. 






2. 






3. 






4. 






5, 






6, 







9. Other sources of population education information 
aside from formal trainings: 



1 I Television 

□ Radio 

I I Newspaper /Magazine 

I I Others, please specify 



10, How much moral support do you get from your 

administrators concerning population education? 

□ very much 

□ much 

□ moderate 

□ little 

□ not at all 
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How supportive or favourable towards population 
education is the community where your school is 
located? 

□ very much 

□ much 

□ moderate 

□ little 

O not at all 

How favourable are the other teachers in your 
school towards population education? 

□ very much 

□ much 

□ moderate 

□ little 

□ not at all 
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PART II 



Directions: Answer sach of the questions by putting a 
check mark U) before the letter which 
indicates the correct or best answer. 

1. The population of the Philippines is: 



2. 



3. 



4. 



5. 



(a) 50 million 

(b) 52 million 



(c) 54 million 

(d) 56 million 



The population of the Philippines is growing at the 
rate of 2.2 per year. At this rate, the population 
will double itself in: 



(a) 30 years 

(b) 32 years 



(c) 34 years 

(d) 36 years 



Which of the following lists of countries shows a 
population ranging from largest to smallest. 

(a) Philipines, Thailand, Indonesia 

(b) Indonesia, Thailand, Philippines 

(c) Thailand, Philippines, Indonesia 

(d) Indonesia, Philippines, Thailand 

Which of the following group of factors must be 
known to estimate the population of few years, hence; 

(a) birth rate, family size, death rate 

(b) birth rate, death rate, migration rate 

(c) birth rate, infant mortality rate, death rate 

(d) birth rate, family size, infant mortality 

Which of the following shapes of the population 
pyramid represent that of a country which has been 
a developed country for a number of years? 
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6. 



8. 



The difference between the birth rate and the death 
rate is called the rate of: 



(a) growth 

(b) population growth 



(c) natural increase 

(d) fertility 



To compute th_ growth rate of the population of a 
country one must know the natural increase and 

(a) migration rate of the nationals. 

(b) migration rate of the foreigners. 

(c) net-migration rate. 

(d) number of Balik-bayans (country home visit) 

coming .uring the year. 

Which of the following groups of demographic factors 
is indicative of a developed country? 

(a) very high birth rate, very high death rate, 

high infant mortality rate. 

(b) high birth rate, low death rate, very low 

infant mortality rate. 

(c) low birth rate, very low death rate, very 

low infant mortality rate. 

(d) very low birth rate, low death rate, very 

low infant mortality rate. 




Which of the sectors in the graph above indicates 

a country which has not entered the transition stage? 



(a) A 

(b) B 



(c) C 
(a) D 
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10. Three of the consequences of rapid population growth 
are : 

(a) land hunger, industrialization, overcrowd- 
ing of schools. 

(b) land hunger, unemployment, overcrowding 

of schools, 
(c) unemployment, overcrowding of schools, 
industrialization. 

(d) industrialization, high school drop out 

rate, high mortality rate. 

11. A large labour force which is a consequence of 
rapid population growth in developing countries 
does not always mean greater output. Which of 
the following statements best explains this? 

(a) A large labour force encourages workers to 

be idle because many share a job which can 
ordinarily be done by a few. 

(b) A large labour force in excess of the 

number of jobs available creates the twin 
problems of unemployment and underemploy- 
ment • 

(c) A larger unskilled labour force generally 

implies low output qualitatively and 
quantitatively. 

(d) Stiff competition over jobs discourages 

people from doing their best. 

12. Which of these statements does not reflect the 
impact of rapid population growth on the human 
environment? 

(a) The pressure on natural resources causes 

scarcities . 

(b) Cities became large and full of slums. 

_ (c) High unemployment, 
(d) Low dependency ratio. 
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13. The term "carrying capacity" of the ecosystem is 
best explained by: 

(a) its capacity to carry a large population. 

(b) its capacity to provide the basic necessi- 
ties. 

(c) its capacity to continue to bear the press- 
ures of population, etc. without destruc- 
tion of the regenerative capabilities. 

(d) its capacity to absorb pollutants. 

14. The immediate goal of population education is to: 

(a) stress family planning as a mean of regu- 
lating fertility behaviour. 
(b) slow down population growth. 

(c) provide background information for rational 

responsible behaviour concerning population 
related matters . 

(d) adopt a two-child family norm. 

15. The statement which best describes family planning 
is: 

(a) the limiting of the number of children. 

(b) a way of ensuring a high quality of life 

for the family. 

(c) not allowing unwanted children. 

(d) spacing the birth of children. 



16. Which of the following best gives the meaning of 
the quality of life <n the population education 
context? 

(a) Having the basic necessities and the 

important aids to modern living. 

(b) Enjoying life that is free from the cares 

of looking after too many children. 

(c) Seeing that your children are given all 

that they desire. 

(d) Being able to lead a healthy, comfortable 

and cultured life. 
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17. Which of the following is not a consequence of 
rapid population growth? 

(a) Overcrowding of classrooms and the lowering 
of the quality of teaching. 

(b) Increase of the dropout rate because of 

the lack of care given to pupils. 

(c) The recruitment of more teachers to meet 
" the increase in school-age population. 

(d) The creation of more opportunities for 
~ higher education. 

18. The biological capability of a woman to have chil- 
dren at a future time within her reproductive age 
is referred to as: 

(a) natality 

(b) fertility 

(c) fecundity 

(d) maternity. 



19. Reduction of population growth rate helps the growth 
of the economy. Which of the following is not a 
-^nsequence of reduced population growth? 

(a) There will be more savings. 

(b) More funds will be invested on capital 

~~ development . 

(c) Less funds will be spent on education. 

(d) A lower dependency ratio. 

20. Which of the following calorie and protein per day 
is considered adequate in the Philippines. 

(a) Male: 2,000 calories, protein 40 grams 
~~ Female: 1,800 calories, piotein 30 grams 

(b) Male: 2,200 calories, protein 80 grams 

Female: 2,000 calories, protein 70 grams 

(c) Male: 3,500 calories, protein 150 grams 

Female: 3,000 calories, protein 120 grams 

(d) Male: 4,500 calories, orotein 200 grams 

Female: 4,000 calories, protein 150 grams 
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PART III 

Directions: Please put a check mark U) on the appro- 
priate column to indicate your agreement 
or disagreement with each statement. The 
letters are coded as follows: 

SA - Strongly, D - Disagree, A - Agree 
SD - Strongly disagree, U - Undecided 



Items |SA 


A 


U 


D 


SD 


1. Developing awareness and understanding 
of population education is the only 
way to improve the quality of life. 












2. The best quality of life means enjoy- 
ing freedom from restrictive mores 
and traditons. 












3. Family size should be limited to 
only two children. 












4. Having a large family (more than 
four children) is a good economic 
insurance for old age. 












5. The ideal age for marriage is at 
least 25 years old. 












6. Population education encourages 
abortion. 












7. Sex education 4-Ka cnlntlnn +r\ 

the rapid population growth of the 
country. 












8. Pre-marital sex is favoured by 
population education. 












9. Population education hinders good 
cultural practices and tradi- 
tional beliefs. 












10. External migration is a solution 
to population problems. 












11. Effective policies for the promo- 
tion of general economic well- 
being is the only key to solving 
unemployment. 












12. Population education should be 
taught as a compulsory subject in 
the secondary schools 














Work schedule* 



Activities 



Aug. 



Sept , 



Oct. 



Nov. 



Dec • 



Jan. 



Feb. 



Mar. 



Apr. 



May 



A. Planning phase 

1. Determine sampling 

2. Instruments preparation 

3. Administrative arrangements 

4. Pretest of instrument 

5. Revision of instruments 

B. Implementation phase 

1. Data collection 

2. Data analysis 

C. Reporting phase 

1. Writing research report 

2. Dissemination of the 
research 



*The work schedule chart given an indication of time allocation 
for completing different activities of the study. 
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Experimental Design 

Title: The Relative Effectiveness of Two Techniques 
of Teaching Population Education to Secondary 
School Students (7th Grade) 

Rationale, Although there is a wide array of 
teaching techniques, only a few evaluative researches 
have been conducted to assess the relative effectiveness 
of one method vis-a-vis other methods, as far as popula- 
tion education is concerned. Hence, this proposed study. 

Objectives , 

1. To measure the effects of using (i) lecture- 
discussion, and (ii) teaching with slides 

on the knowledge and attitude of students. 

2. To determine if there is a significant rela- 
tionship between respondents' demographic 
characteristics and type of school, on the 
one hand, and their knowledge and attitude 
concerning population, on the other. 

Conceptual framework . Illustrated below 1^ the 
conceptual framework of the study: 



Techniques: 

1 . Lecture-discussion 

2 . Teaching with 
slides 








(Change in) know- 
ledge and 
attitude 


* 



1. 


Age, sex of 


learner 


2. 


Location of 


school 


3. 


School type 





Scope. Focus will be on the concepts of population 
growth and economic development. These are as follows: 
(i) Population trends in the community; (ii) Effects 
of rapid population growth on the age structure of a 
community; (iii) Implications of young population on 
the economic development of the community; and (iv) Re- 
lation between per capita income and economic development. 
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Procedure. Materials about the concepts will be 
taught to the four groups by the same teacher for one 
month* 

The pretest will be administered to the first 
group before it is exposed to teaching with slides. 
The second group will also be given a pretest, then sub- 
jected to lecture-discussion. Both groups will take 
the post-test- The third group will be exposed to teach- 
ing with slides while the fourth group will have lecture- 
discussion, and both groups will take the post-test. 

The research instruments will be knowledge and 
attitude tests covering the topics on population growth 
and economic development. 

Hypotheses. 

i) The mean scores of students exposed to teach- 
ing population education with slides will 
differ from those taught by lecture-discussion 

ii) There are differences in the attitudes of 
students in the two groups toward certain 
population issues; and 

iii) There are significant relationships between 
the respondents' demographic characteristics 
and type of schools, on the one hand and 
their knowledge and attitude on the other. 

It is expected that the results of the study will 
show the relative effectiveness of the two techniques 
on knowledge gain and the development of attitudes in 
seventh grade students. 

Methodo logy. 

1. The study will use the multiple group, alter- 
nate pretest-post-test design which is illus- 
trated on the following page: 
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Time 




Experimental Group^ 


(R) 


Ol X 




Control Groups 


(R) 


o 3 -X 




Experimental Group2 


(R) 


X 


05 


Control Group2 




-X 


°6 



Legend: 0^ and O3 are pretests. 

®2> ^5 anc * ^6 are post-test. 

X = teaching with slides. 
~X = lecture-discussion. 



The design is sometimes called the Solomon 
four-group design. It is chosen because the pre- 
test will serve as an initial measure on which 
to base change or gain in knowledge and attitudes 
of the respondents subjected to two teaching tech- 
niques. Practice test effects or test sensitiz- 
ation which may affect the post-test (if any) can 
also be observed by comparing the post-test scores 
of the four groups. 

The design stresses these two criteria: 
(i) randomization, and (ii) presence of a com- 
parison group (control and experimental). 

Subjects. The subjects of this study are seventh 
grade secondary scliool students. Two hundred students 
will be randomly selected in one school. The 200 students 
will be randomly divided into four groups, then randomly 
assigned to E 1§ C 1§ E 2 and C 2 groups. 

Instrumentation. In preparing the research in- 
struments, a table of specifications was used (see 
Table 3). Likewise, after the experimental trial use 
of the research instruments, item analysis was done 
(Tables 4 and 5). The research instruments were revised 
accordingly, inter alia on the basis of the findings 
of the item analysis. The revised research instruments 
are attached. 
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Table 3, Specifications 



Content 



Population growth 
and economic 
development 



1. Population 
trends in the 
community 



Item number on knowledge 



1 2 3 4 5 6 7 8 9 10 11 12 13 



14 



15 



16 



17 



18 



19 



20 



Total 



Item number 
on attitude 



123456789 10 



Total 



2. Effects of RPG 
on the age 
structure of a 
population 



3. 



Implication of 
young popula- 
tion on the 
economic devel- 
opment of the 
community 



Relation be- 
tween per 
capita income 
and economic 
development 



1 
10 



Grand total 



20 
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Table A. Summary of item analysis on knowledge 



Item No. 


Option 


Difficulty 
Levei 


A 


B 


c 


D 


1 


© 


3 


5 


1 


82% 


9 


A 


15 


© 


10 


A2% 


J 


1 


© 


6 


1A 


58% 


A 


0 


® 


21 


1 


56% 


•J 


8 


® 


7 


15 


A0% 


A 

u 


9 


© 


5 


11 


50% 


7 


6 


3 


© 


6 


70% 


8 


© 


A 


1 


1A 


62% 


9 


12 


A 


8 


© 


-52% 


10 


13 


10 


A 


© 


A6% 



Because the difficulty level of item number 1 
is high (82 per cent), this particular item was 
revised . 
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Table 5. Summary of item analysis on attitude 



Item No. 


Option 


Mean 
Scores 


A(3) 


U(2) 


D(l) 


1 


35 


5 


10 


2.5 


2 


43 


4 


3 


2.74 


3 


23 


© 


10 


2.26 


4 


37 


7 


6 


2.62 


5* 


9 


© 


27 


2.36 


6* 


30 


© 


8 


1.56 


7 


34 


10 


6 


2.56 


8 


40 


6 


4 


2.72 


9 


36 


9 


5 


2.62 


10* 


11 


6 


33 


2.44 



In view of the fact that the mean score for item 
number 6 is 1.56, it was deemed necessary to revise the 
item. 
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PART I 

Test in Population Education 

Name: Age: Sex: 

School: 



Directions: Encircle the letter of the correct answer. 

1. When population growth is rapid, a country has a: 

a) higher percentage of young people. 

b) higher percentage of older people. 

c) higher proportion of working adults. 

d) large labour force. 

2. Rapid population growth will also: 

a) help the country to produce more resources. 

b) improve quality of life. 

c) decrease per capita income. 

d) increase food production. 

3. The effect of a high dependency burden on the econo- 
mic status of a community calls for: 

a) increased savings . 

b) more jobs. 

c) higher taxes. 

d) high level of income. 

A. The age group 15 and below in a population is called 

a) working group. 

b) young dependents. 

c) school going population. 

d) old dependents. 

5. The proportion of dependent group to the working 
group is called: 

a) young dependency ratio. 

b) dependency ratio. 

c) unemployment rate. 

d) employment rate. 
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6. The annual national income is called; 

a) per capita income. 

b) gross national product. 

c) national savings from expenditures. 

d) total tax-returns. 

7. There is increase in population, if: 

a) birth and death rates remain the same. 

b) both birth and death rates decrease. 

c) the birth rate increases and the death rate 

decreases. 

d) the birth rate decreases and the death rate 

increases • 

8. A population with a young age structure will result 
in: 

a) high dependency burden. 

b) low dependency burden. 

c) increased death rate. 

d) increased birth rate. 

9. The effects of reduced birth rate in the community 
is that: 

a) the proportion of children to adults is reduced. 

b) public and private savings increases. 

c) number of dependents increases. 

d) dependency ratio becomes low. 

10. A population problem exists, if: 

a) the annual growth rate is low, 

b) the population grows faster than the resources 

to maintain that population. 

c) the cost of living increases every day. 

d) the population settles in urban areas. 

11. When there are more and more young people in the 
community it means: 

a) economic development will be faster. 

b) dependency ratio will be low. 

c) more jobs will be needed. 

d) per capita income will increase. 
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When the population of a community is getting 
younger, which of these may result? 

a) more money spent for the education of its 

population. 

b) high rate of development. 

c) low dependency ratio. 

d) better job opportunities. 

What is the effect of rapid population growth on 
the number of school children? 

a) The larger the population, the larger the 

number of school children. 

b) The larger the population, the smaller the 

number of school children. 

c) The increase in population does not affect the 

number of school children. 

d) The increase in population affects the number 

of school children. 

Rapid population growth in a community means: 

a) Young people are increasing faster than old 

people • 

b) Old people are increasing faster than young 

people . 

c) All age groups are increasing fast. 

d) Some age groups are increasing, others are 

decreasing. 

If a community has a growing young population, it 
will need: 

a) less money on public facilities. 

b) more housing projects. 

c) better schools. 

d) less money spent on health projects. 

To increase the per capita income of a community, 
there is a need to: 

a) lower the population growth rate. 

b) step-up economic development. 

c) improve the educational level of the people. 

d) all of the above. 
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45 
40 
35 
30 
25 
20 
15 
10 
5 



1970 1975 1980 1985 



17. The graph above shows the first doubling of popu- 
lation in the year: 

a) 1970 

b) 1975 

c) 1980 

d) 1985 

18. Which of the following statements best describes 
Comuunity A's population growth from 1970 to 1985? 

a) Growth is slow. 

b) Growth is fast. 

c) Growth is uniform. 

d) There is no trend. 

19. The graph above shows that there is a high depen- 
dency burden because of: 

a) young age group. 

b) working group. 

c) adult group. 

d) formal group. 

20. Which statement is true? 

a) It took less time for the population to double. 

b) There is no definite time for doubling the 

population. 

c) It took 10 years for the population to double. 

d) Doubling time is not seen in the above graph. 
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PART II 

Directions: These are some statements of opinions held 
by people. Read each statement carefully. 
Opposite each statement you will find three 
responses. Check the appropriate column 
which represents how you feel about each 
statement • 



Item 


Agree 


Undecided 


Disag ree 


1. I think the economic growth of my 
community will slow down if 
population grows too fast. 








2. Housing is usually a problem in 
an over-crowded city. 








3. City life offers more attrac- 
tions than rural life. 








4. If population grows too fast un- 
employment is likely to be a 
serious problem. 








5. I do not think over-crowding 
will give rise to crimes. 








6. As the population grows fast, 
life becomes better because 
there is fast economic growth. 








7. Per capita income will increase 
with greater agricultural 
production. 








8. If the children in a country 
increase too fast, it will be 
difficult to give all of them a 
good education. 








9. Rapid population growth is one 
of the major causes of unemploy- 
ment among poorer socio-economic 
groups in any community. 








10, We do not need to worry about 

population growth since there, is 
enough food for the people. 
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Work Schedule* 







Activities 


Months 








I 


II 


III 


IV 


V 


v l 


A. 


Planning phase 
















1. 


Determine sample 
















2. 


Prepare design and 
instruments 
















3. 


Train teachers and super- 
visors 


— 














4. 


Pretest instruments 
















5. 


Revise instruments 














B. 


Implementation phase 
















1. 


Administer pretest to two 
groups (experimental and 
control) 
















2. 


Teach using lecture-discus- 
sion approach to two 
groups; teach with slides 
to the other two groups 
















3. 


Administer post-test to the 
four groups 
















4. 


Check the test papers on 
knowledge and attitude 
















5. 


Tabulate data 














C. 


Analysis phase 
















1. 


Analyze data 
















2. 


Write research report 














D. 


Reporting phase 
















1. 


Print report 
















2. 


Disseminate report 
















3. 


Present findings at a 
conference 















*The work schedule chart gives an indication of time allocation 
for completing different activities of the study. 
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Quasi-Experimental Design 



Title: An Evaluation of an Innovative Approach to In- 
Service Training of Middle School Teachers of 
Population Education 

Rationale . There is a dearth of good evaluative 
research studies in the field of population education. 
For a sensitive area like population education, teacher 
training is an essential pre-requisite . Innovations 
in teacher training programmes will stimulate and enhance 
the quality of teaching. Hence, there is a continuing 
need to search for innovations in the teacher training 
programme which would instil confidence among teachers 
for effective teaching of population education. 

Though many innovative approaches have been iden- 
tified, most of them have not been evaluated; hence, 
teacher trainers, policy/decision makers and users are 
not cognizant of their value. The present study is an 
attempt to determine the effectiveness of one such 
approach so that it could be widely disseminated later. 

Objective . 

a) Gene^rl. T u ascertain the ettectiveness of 
an innovative approach in the in-service 
training of middle school teachers of popula- 
tion education. 

b) Specific. 

i) To assess the enhancement of the com- 



Conceptual framework . The continuum of tra- 
ditional versus innovtive training modality is presented 
below: 



petence of teachers trained by this inno- 
vative approach in terms of knowledge, 
attitude and teaching skills. 



ii) 



To determine if repeated testing prior 
to training affects the training outcome. 



Traditional 



Innovative 



Trainer-centered * 
Trainee passive 



♦ Trainee-centered 

♦ Trainer as facilitator 
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Traditional 

Memorization-doling out. 
of factual information 

"Chalk talk" lecture «— 

Use mainly textual ^ 

materials 



Innovative 
'Concept attainment 



Theory focused 4 

Learning in classroom 
only 



■^Problem solving 

Use variety of learn- 
ing materials 

Theory, application 
and practice focused 

Classroom and surround- 
ing environment 



Among the innovative training modalities envisioned 
for this study are group discussion, role-playing, field 
trip and the use of flash cards, charts and posters. 

The present study seeks to determine how effective 
is the innovative approach. It assumes that if an ap- 
proach is really effective, its results would show up 
consistently. 

Since randomization is not feasible, this study 
will use a quasi-experimental design using three groups 
and one treatment. The research framework is as follows: 



The innovative 
approach 



leads to 



Change in: 

a) knowledge 

b) attitude 

c) teaching skills 



The independent variable is the treatment, i.e. 
the innovative approach. 

The dependent variables are: (a) knowledge, 
(b) attitude, and (c) teaching skills. 

The research design to be used is as follows: 









Time 


Group 


I 


0 1 X 


o 2 


Group 


II 


0 3 


O4 x o 5 


Group 


III 


06 


o 7 x o 8 
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where 0^, O3 and O5 are the initial pretests 
02» O5 and O3 are the post-tests 
X is the treatment (innovative approach) 

The treatment X is effective if: 

02 > 0i 
O5 > o 4 
0 8 > o 7 

There are effects of practice, maturation 
and/or contamination if: 

O4 > 0 3 
0? > o 6 

If 0 2 does not differ much from O4 nor if 
O5 is not much different from O7, then 
the treatment is ineffective. 

Hypotheses. 

1. The mean score on the post-test of each group 
is higher than the corresponding pretest mean 
score. That is: 



Group I 
Group II 
Group III 



M 2 > M x 

M 5 > M4 Where M's are 
M 8 > M 7 



mean score, 



2. There are no practice effects resulting c rom 
repeated pretests, that is: 

Group II: M4 - M 3 
Group III: M7 * M5 

Methods and procedures. Three groups of teachers, 
each consisting of 50 will be identified for training 
as per the schedule of the training programme of the 
implementing agency. The duration of training for each 
group will be seven days, but with some definite time 
intervals. The first srioup will undergo training for 
a week. During that time, the innovative approach will 
be used* 

At the end of the seven-day training programme, 
the first group will be given a post-test. The same 
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pretest and post-test instrument will be administered 
to Group II just before the group undergoes the same 
seven-day in-service training. At the end of the seven- 
day training, the group will be given a post-test. At 
about the same time, the third group will be administered 
the same instruments, and just before the group undergoes 
the same training programme as the first two groups. 
Like the first two, the third group will be given a 
post-test . 

In all three groups, gains in scores (difference 
between immediate pretest and post-test) will be ana- 
lyzed. For the latter two groups, the gain in scores 
between the first pretest and the pretest immediately 
before the treatment will be analyzed to try to account 
for effects of testing and maturation. 

Instruments. Three sets of instruments to assess 
knowledge, attitudes and skills of the teachers shall 
be used. The first instrument designed to measure knov- 
.ledge and knowledge gains in population education, con- 
sists of about 30 multiple-choice items. The second 
instrument designed to assess attitudes towards popula- 
tion education consists of about 20 Likert Scale items. 
The third instrument, a self-perception scale to ascer- 
tain development of teaching skills, is a five-point 
scale ranging from "very much" to "none at all". 



Table 6. Specifications 





Knowledge 




Skills 
practice/ 
behaviou ral 
teaching 
skills* 




Content/ 
core message 


Decision- 
Concept , , 

making 


Atti- 
tude 


Total 


1. Family size and 


5 7 


7 




19 


family welfare 








2. Delayed marriage 




3 




4 


3. Responsible 




3 




4 


parenthood 










4. Population and 




4 




7 


development 










5. Others 




6 


8 


17 


1 Total 


13 7 


23 


8 


51 
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Table 7. Item analysis: Knowledge test 





Knowledge concept 










Percentage 






A 


B 


C 


D 


of correct 
answers 


Remarks 


1. 


Census 


© 








100.00% 


Too easy 


2. 


Dependency 










OS Aflt 
,0} 


_ 

Too easy 


3, 


Zero nonulation 
growth 


4 


(16) 


3 


1 


66.67% 


4. 


Mortality rate 


1 




2 


1 


83.33% 


Too easy 


5. 


Birth spacing 


3 


1 




© 


83.33% 




6 


OHinftiuA of rv^nn- 




© 












lation education 


1 


2 


20 


4. 16* 






teaching fer- 












tility 














7. 


Fertility 


© 


14 






41.67% 




8. 


Breast-feeding 


(ia) 


1 


2 


3 


75.00% 




9. 


Responsible 
parenthood 










Q 1 tiff 


Too easy 


10. 


Indicator of eco- 
nomic development 




1 






87 SO*, 




11. 


Doubling of 
population 






*• 


o 
0 


29. 17% 




12. 
13. 


Population pyramid 


11 

1 1 


6 

O 


1 




25.00% 
29.00% 




14. 


Dofnoa ra nh i r furtrtr^ 




J 


ID 


(7) 


on 1 -iff 
/V , 1 / » 




15. 


Consequences of ra- 














piu population 










1 AA rtftff 

100.00% 


Too easy 




growth 












16. 


TmnAPt* of mm 1 1 a - 
















tion growth cn 


1 


1 


4 


© 


75.00% 






environment 














17. 


Ecosystem 


1 


6 






70.83% 




18. 


Goal of population 
Education 


2 


2 






83.33% 




19. 


Defining family 
planning 


2 


© 




7 


62.503 




20. 


Quality of life 








© 


100.00% 


Too easy 



The test items that are either too easy or too difficult were 
revised accordingly. 
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Table 8. Item analysis 
Attitude Test 



Item 


Frequency of choice 


Mean 


Remarks 




SA 


A 


U 


D 


SO 


Rating 


1. Effect of popula- 
tion growth on 
economy. 


13 


11 


0 


0 


0 


0 


should be re- 
vised in view 
of the low 
variance in 
responses. 


2. Family size effect 
on undernourish- 
ment.* 


1 


10 


0 


8 


4 


2.71 


3. Children are 

needed to help the 
parent in farm 
work. 


2 


8 


0 


11 


3 


2.79 




4. Rapid industrial- 
ization solves 
population problem. 


4 


9 


2 


8 


0 


3.25 




5. The family plan- 
ning programme 
must be stopped. 


1 


0 


0 


13 


10 


1.71 




6. A big family cannot 
give all its chil- 
dren a good educa- 
tion. 


6 


10 


1 


4 


3 


3.5 




7. Rapid population 
growth will weaken 
our country. 


3 


7 


0 


13 


1 


2.92 




8. Women who work out- 
side the home pre- 
fer to have small 
families. 


11 


13 


0 


0 


0 


I 4.401 


should be re- 
vised in view 
of the low 
variance in 
responses. 


9. Pollution is 

largely a problem 
of poor countries. 


2 


10 


0 


9 


3 


2.92 




10. Birth control is 
the f inal solut ion 
to the population 
problem. 


8 


12 


2 


2 


0 


4.08 




11. Population educa- 
tion improves the 
quality of life. 


9 


12 


0 


2 


1 


4.08 




12. Tradition affects 
the quality of 
life. 


1 


12 


2 


8 


1 


3.17 
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Item 



Frequency of choice 



SA A U 



SD 



Mean 
Rating 



Remarks 



13. The ideal age for 
marriage is 25 
years. 

14. Abortion should be 
legalized, 

15. Sex education 
solves the popula- 
tion problem, 

16. Pre-marital sex 
is acceptable, 

17. Greater economic 
production solves 
the problem of 
developing 
countries, 

18. External migra- 
tion causes 
more problems, 

19. Effective econo- 
mic policies 
solve under- 
nourishment. 

20. Better teachers 
of population 
education 
improve the 
future quality 
of life. 



1 

11 

0 
3 



4.13 
1.83 

3.58 
2.21 

4.13 
3.25 

3.79 



16 



4.17 



Legend : 



SA * 


5 


A * 


4 


U = 


3 


D * 


2 


SD * 


1 



♦Negatively-oriented items; the scoring was reversed in getting 
the composite score. 
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Background Information 



1. Name 



2. School 



3. Sex: □ Male □ Female 



Age 



Civil status: 



6. Religion: 



□ Single 

□ Married 

□ Divorced 

□ Widowed 



□ Under 20 

□ 21-25 

□ 26-30 

□ 31-35 

□ 36-40 

□ 41-45 

□ 46-50 

□ above 50 



I I Christianity 

□ Hinduism 

□ Islam 

□ Buddhism 

□ Others, please spcify 



7. Teaching qualifications 

□ B.Ed. /B. Sc. 

I I Certificate for teaching/advanced 
D Certificate for teaching/primary 

□ Local certificate for teaching 
I I None 

8. Teaching experience: 

I I Less than two years 

I I 3-5 years 

I I 6-9 years 

□ 10 and more 

9. Subjects teaching: 

I I M/Language □ English language 

I I Environmental studies CD Others, please 

I I Mathematics specify m 

I I Social studies 
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PART I 



Knowledge Test 



2. 



3. 



4. 



5. 
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actions: Put a check mark U) before the best answer 
in each of the following items. 

A count of the population in a given place at a 
given time is known as a population 

a) census 

b) sampling 

c) estimate 

d) projection 

A country has a high dependency group if it has a 
big population. 

a) under 15 years of age 

b) 65 years of age and over 

c) between 45 and 65 years of age 

d) both under 15 years of age and 65 years of age 
and above 

Supposing you read in a newspaper that country X has 
a zero population growth, what does it mean? 

a) The population of country X is decreasing. 

b) Its number of people remains the same. 

c) Less people are born than those who die in 

country X. 

d) Nobody is dying in country X. 

Which of the following groups has the highest death 
rate? 

a) children 

b) infants 

c) working fathers 

d) mothers of reproductive age 

Spacing of births results in: 

a) proper nutrition of mother and child 

b) lower infant mortality rate 

c) lesser incidence of defective children 

d) all of the above 
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6. The main objective of teaching population education 
to young children is to help them: 

a) know about population problems 

b) form desirable attitudes about population 

issues 

c) be prepared for married life 

d) all of the above 

7. Which of these refers to the biological capacity 
of a woman to reproduce? 

a) Fertility 

b) Fecundity 

c) Heredity 

d) Morbidity 

8. A breast feeding mother generally conceives later 
than women who do not breast feed because: 

a) her ovulation is delayed 

b) she is sexually ineffective 

c) she is too busy attending to the nutrition 

of her baby 

d) she is not healthy enough 

9. "Responsible parenthood" means: 

a) complete control of all the activities of the 

family 

b) achieving quality of life for all members of 

the family 

c) allowing maximum freedom to all members of 

the family 

d) having enough money to meet the food needs 

of all members of the family. 

10. Which of these is not generally an indicator of 
economic development? 

a) A large dependent population 

b) Improved industrialization 

c) High per capita income 

d) Increased production. 
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The population of the Philippines is growing at the 
rate of 2.2 per year. At this rate, the population 
will double itself in 

a) 30 

" b) 22 

c) 34 

d) 36 

Which of the following shapes of the population 
pyramid represent that of a developed country. 




The difference between the birth rate and the death 
rate is called the: 

a) growth rate 

b) natural population growth 

c) natural increase 

d) fertility rate 

Which of the following groups of demographic factors 
is indicative of a developed country? 

a) very high birth rate, very high death rate, 

very high infant mortality rate. 
b) high birth rate, low death rate, very low 

infant mortality rate. 
c) low birth rate, very low death rate, very 

low infant mortality rate. 
d) very low birth rate, low death rate, very 

low infant mortality rate. 

Three of the consequences of rapid population 
growth are: 

a) land hunger, industrialization, overcrowd- 
ing of schools. 

b) land hunger, unemployment, overcrowding 

of schools. 

c) unemployment, overcrowding of schools, 

industrialization. 
d) industrialisation, high school drop out 

rate, high mortality rate. 
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16. Which of these statements best explains the impact 
of rapid population growth on the human environment? 

a) The pressure on natural resources causes 

scarcities . 

b) Cities become large and full of slums. 

c ) Unemployment. 

d ) All of the above. 

17. The term "carrying capacity" of the ecosystem is 
best explained by: 

a) its ability to carry a large population. 

b) its capacity to support a large population. 

c) its ability to continue to bear the pres- 
sures of pollution, etc. without destruc- 
tion of the regenerative capabilities. 

d) its capacity to absorb pollutants. 



18. The icnediate goal of population education is to: 

a) stress family planning as a means of regu- 
lating fertility behaviour. 

b) slow down population growth. 

c) provide background information for national 

and responsible behaviour concerning 
population related matters. 

d) auopt a two-child family norm. 



19. The phrase which best describes family planning is: 

a) limiting of the number of children. 

b) a way of ensuring a high quality of life 

for the family. 

c) not allowing unwanted children. 

d) spacing the birth of children. 



20. Which of the following gives the best meaning of 

quality of life in the population education context? 

a) Having the basic necessities and the 

important aids to modern living. 
b) Enjoying life that is free from the cares 

of looking after too many children. 
c) Seeing that your children are given all 

what they desire. 
d) Being able to lead a healthy, comfortable 

and cultured life. 
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PART II 

Attitude Test 

Please put a check mark U) in the appropriate 
column to indicate your agreement or disagreement with 
each of the statements below. The column headings have 
these meanings: 

SA * Strongly agree 
A = Agree D = Disagree 

U = Undecided SD = Strongly disagree 





SA 


A 


U 


D 


SD 


1. Economic growth in this country will 
be hindered if nonularl on arnuQ t-nn 
fast . 












2. Family size is not the major cause 
of undernourishment among the 
poorer socio-economic groups in 
this country. 












3. For farm families, manv rhilrfrpn 
are needed to help the parents in 
farm work. 












4. Rapid industrialization is the 
only answer to solve population 
problems in a developing country. 












5. Family planning programme 
must be stopped immediately 
because it is against religion. 












6. In a big family, it is very 
difficult to give all the chil- 
dren a good education. 












7. Rapid population growth will 
weaken the security and defense 
power of the country. 












8. Women engaged in jobs outside 
the home generally prefer to 
have small families. 
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< 


5A 


A 


U 


D 


SD 


9. Pollution is more a problem of 
poor countries than rich 
countries. 










10. The final solution to the popula- 
tion problem lies in limiting 
the number of children per couple. 












11. Developing awareness and under- 
standing of the population 
situation is the only way to 
improve quality of life. 












12. The best quality of life means 
enjoying freedom from restric- 
f-i vo mnrp<* and traditions. 












13. The ideal age for marriage is 
at least 25 years old. 












14. Abortion should be legalized 
in this country. 










- — 


15. Sex education is the solution 
to the rapid population growth 
of the country. 












16. Premarital sex is now accept- 
able in society. 












17. Greater economic production is 
the best answer to the problems 
of developing countries. 










18. External migration causes more 
problems than internal migration. 












19. Effective policies for the pro- 
motion of general economic well- 

hoH ner -to fhp nnlv k.eV to solv" 

ing undernourishment. 












20. Effective teaching of population 
education will improve the 
quality of life in the future. 
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PART III 

Self-Perception of Teaching Skills 

How much difficulty do you find in doing the fol- 
lowing teaching activities? Answer by putting a check 
mark (/) in the appropriate column which matches your 
answer . 





Very 
much 


Much 


Mod- 
erate 


Little 


Not 

at 

all 


1. Writing lesson plans. 












2. Sustaining interest of the 
pupils. 












3. Asking appropriate questions 
during the lessons. 












4. Presenting concepts clearly. 












5. Citing relevant examples to 
illustrate concepts. 












6. Encouraging participation of 
the pupils. 












7. Maintaining c.^ssroom disci- 
pline. 












8. Observing time schedules of 
the day. 












9. Diagnosing pupils 1 difficul- 
ties i.i understanding the 
concepts. 












10. Using appropriate visual aids 
(charts* boardworks, flash 
cards* etc.) 












11. Preparing visual aids yourself 
(charts* boardwork* flash 
cards* etc.) 












12. Recapitulating the lesson to 
assess what the pupils 
learned during the session. 












13. Constructing test items. 
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PART IV 



Observation Rating Scale for Teaching Skills 

Observer Class observed 

School Date and time 

Topic taught No. of students 

Duration of the period 



Please rate the performance of the teacher observed 
on the following teaching skills by checking (/) the 
appropriate column. 





Excel- 
lent 


Very 
good 


Good 


Poor 


Very 
poor 


1. Writing lesson plans.* 












2. Sustaining interest of the pupils. 










_ 


3. Asking appropriate questions 
during the lesson. 












4. Presenting concepts clearly. 












5. Citing relevant examples to 
illustrate concepts. 












6. Encouraging participation of 
pupils. 












7. Maintaining classroom discipline. 












8. Observing time schedule. 












9. Diagnosing pupils lif f iculties 
in understanding the concepts. 












10. Using appropriate visual aids, 
(charts, boardworks, flash 
cards, etc.) 












11. Preparing visual aids (charts, 
boardworks, flash cards, etc.) 












12. Recapitulating the lesson to 
assess what the pupils learnt 
during the session. 












13. Constructing test items.* 













•Please refer to the lesson plans or tests prepared and used by 
the teacher. 
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Work schedule* 



Activities 



A. Planning phase 

1. Determine sample 

2. Design instrument 

3. Pretest instrument 

4. Revise instrument 

B. Implementation phase 

1. Pretest 

2. Training 

3. Post -test 

4. Tabulate data 

C. Analysis phase 

1. Analysis of data 

2. Write research 
report 



• First year 



Jan Feb Mar Apr May Jun Jul Aug Sept Oct Nov Dec 



Second year 



Jan Feb Mar Apr May Jun Jul 



*Vlork schedule chart gives an indication of time allocation for 
completing different activities of the study. 
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Non-formal population education 

The Non-Formal Population Education Group (Group 
II, Annex B) developed two evaluative research designs, 
namely (i) an experimental design, entitled "The Rela- 
tive Effectiveness of Two Modalities of Non-Formal 
Education Teacher /Tutor Training i. Population Education, 
and (ii) a quasi-experimental design, entitled "Effects 
of a Non-Formal Population Education Programme on the 
Knowledge of and Attitude Towards Responsible Parent- 
hood and Family Planning of Adults Attending Literacy 
Classes in Community X". The evaluative research de- 
signs, together with the research instiuments are pre- 
sented below and the pages which follow. 

Experimental design 

Title: The Relative Effectiveness of Two Modalities of 
Non-Formal Education (NFE) Teacher /Tutor Train- 
ing in Population Education 

Rationale , Many countries of Asia and the Pacific 
are concerned about the adverse effects of rapid popu- 
lation growth on qualitv of life. There is a general 
recognition that an educational intervention in the 
form of exposure to population issues and problems could 
sensitize children, youth and adults to the importance 
of moderate fertility behaviour. In-school programmes 
of population education have already been launched in 
several countries, but there are many youth and adults 
who have not been exposed to population education for 
a variety of reasons and it is necessary to reach them 
through NFE programmes. For this purpose, it is necess- 
ary to train teachers/tutors. In view of the fact that 
different modalities of training may not be equally 
effective, it is important for the programme staff tc 
ascertain which modalities are effective. 

This study seeks to determine the effectiveness 
of two popular modalities, namely; face-to-face training 
and a self-instructional training. 

Objectives 

1. To assess the relative effectiveness of face- 
to-face training and self-instructional train- 
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ing of teachers from rural areas to teach 
population content in NFE programmes; and 

2. To identify changes that are necessary in 
one or the other modality to improve it. 

Conceptual framework . After the training, 
teachers/tutors are expected to acquire knowledge, atti- 
tudes and skills (KAS) to teach population content 
effectively in NFC classes either through integration 
or as a separate course, the training modalities em- 
ployed being face-to-face training and self-instructional 
training scheme. The conceptual framework is illustrated 
in the model below: 



NFE population edu- 
cation training 
using: 

i) Face-to-face 
ii) Self- 
instructional 



KAS in 
popu la t ion 
education 



Hypotheses . 
hypotheses: 



This study posits the following 



1. The mean scores in knowledge of NFE teachers/ 
tutors taught through the self-irstructional 
training modality will differ from those 
trained using the face-to-face modality. 

2. Mean scores in attitudes of teachers/tutors 
trained using self-instructional modality 
will differ from those of teachers trained 
in the face-to-face modality. 

Methodology . Design - Experimental: The true 
control group, pretest-post-test design will be used 
in this study. The design is illustrated in the diagram 
below: 





— ► 

Pretest Post-test 


Self -instructional 
training 


(R) 0 X X 0 2 


Face-to-face training 


(R) 0 3 -X 0 4 
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Where: Oi and O3 * Pretests 

O2 and O4 « Post-tests 

X - Self-instructional training modality 
which is the treatment 
-X = Face-to-face training modality, 
the alternate programme 

Variables and measures . The independent variable 
or the treatment variable in the study is self -instruc- 
tional training modality. This refers to a scheme 
whereby teachers are trained through self-learning 
modules in population education. The content of this 
experimental modality is parallel to that of the usual 
face-to-face training scheme. 

The trainees shall study the materials on their 
own and this self-study is interfaced with sessions 
wit 1 a trainer for discussions/explanations of learning 
points and reinforcement of learning through film show- 
ing and lectures by resource persons. The duration 
is two weeks. 

The alternate programme is the face-to-face train- 
ing modality. This is the treatment given to the con- 
trol group. The scheme is the usual modality by which 
NFE tutors/teachers are trained. The duration of the 
training is six to seven days. 

The dependent variables are knowledge, attitudes 
and skills in population education. Knowledge in popu- 
lation education refers to scores in a population edu- 
cation test administered to the trainees. The knowledge 
items include population information in the areas of 
the core messages of the national population programme. 
These are (i) family size and family welfare, (ii) de- 
layed marriage, (iii) responsible parenthood and family 
planning, and (iv) population and other development 
concerns. Attitudes in population education refers to 
scores in an attitude rating scale, administered to the 
trainees. The attitude items include statements oZ 
beliefs and opinions related to population-related 
issues. Skills in population education refers to ratings 
of perceptions of help needed by NFE tutors/teachers 
with regard to certain tasks in teaching population 
education . 
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Respondents . One hundred and twenty NFE tutors/ 
teachers randomly selected and assigned to an experimen- 
tal group (self-instructional) and a control group 
(face-to-face) shall constitute the respondents of the 
study. 

Sampling . A rural community will be selected 
from the census blocks using purposive sampling follow- 
ing a set of criteria, e.g. a community with the most 
number of untrained teachers/tutors, rural community, 
etc. Afterwards, the 120 teachers/tutors will be chosen 
from a roster using the table of random numbers. 

The selected samples will then be broken into two 
groups (Experimental and Control) by drawing lots or by 
tossing a coin. A group of 30 shall constitute a class 
size. Hence, there shall be two classes in the exper- 
imental group and two classes in the control group. 
Training using self-instructional and the alternate 
programme shall be conducted simultaneously. 

The four trainers who will conduct the simul- 
taneous training programme shall be selected and made 
comparable in terms of educational qualification, ex- 
perience in teaching non-formal education, previous 
training in population education, performance rating 
and age • 

Research instruments . A questionnaire on know- 
ledge, attitude and skills (KAS) in population education 
is the main instrument for gathering the relevant data. 

The following steps will be followed in the prep- 
aration of the instrument! 

1. Prepare a table of specifications based on 
the training design for NFE tutors/teachers 

in order to determine the coverage of the test 
items • 

2. Pretest the instruments on a group similar to 
the research samples. 

3. Revise and finalize the instruments. 

The KAS questionnaire is included in this proposal. 
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Table 9. Specifications 





flnnfpnf of 

v> U 11 U C 11 L» \J± 


Number of items 


training 


Knowledge 


Accicuaes 


o K111S 


A. 


Core messages 










1. Family size and 


2 


4 






family welfare 










2 • Delayed marriage 


1 


1 






3. Responsible pa- 










renthood and 


2 








family planning 










A PrkTMi 1 a t" H nn st ne\ 
h» r upuia iiuu aiivj 










other develop- 


3 


2 






ment concerns 








■n 

D • 


Demographic concepts 


4 






c. 


Population education 










1. Teaching methods 


1 




10 




2. Evaluation 






A 
u 




3. Integration of 










population edu- 










cation in NFE 


1 


3 


5 


D. 


Andragogy 


1 




1 


Total 


15 


10 


22 
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Table 10. Item analysis of responses 
to knowledge Items 



Items 


Facility 


Response options 


level % 


a 


b 


c 


d 


1 

2 


33.3 
61.1 




7 

(n) 


3 


77 


NR - 1 
NR - 1 


3 


44.4 


- 


© 


2 


8 




4 


5.6 


2 


l 




14 




5 


94.4 


1 










6 


27.8 


4 


3 




6 




7 


22.2 


2 




12 




NR - 1 


8 


50.0 


1 


3 


5 






9 


38.9 




© 




4 




10 


94.4 


1 




© 







Analysis: 
1. 



Item 4 - the correct response is letter c, 
however, letter d appears to be a very attrac- 
tive option/answer. There is a need to change 
this alternative response to make it a wrong, 
but plausible response alternative. 

Items 5 and 10 are very easy items. These do 
not discriminate the knowledge level of res- 
pondents. There is a need to change the items 
to more discriminating ones. 

Item 6 is a difficulut item. However, it is 
a good pretest item on the concept. 



*CD encircled numbers 
responses. 



number who got the correct 
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Table 11* Item analysis of responses 
to attitude items 



Items 


Response options 


Mean 


SA 


A 


U 


D 


SD 


1 


7 


5 


1 


4 


- 


3.7 


2 - * 


3 


1 


5 


8 


1 


3.2 


3 


10 


8 








4.6 


4 _ * 


2 


2 


5 


c 
0 




3.4 


c 

5 


5 


10 


1 


1 


1 




6 


8 


9 




1 




4.3 


7 


11 


7 








4.6 


8 


7 


10 


1 






4.3 


9 


8 


8 




1 


1 


4.2 


10 


3 


8 


2 


2 


2 


3.3 



*Negatively-oriented statements - Scoring was 
reversed: SD - 5, D - 4, etc. 



Analysis: 

1. Items 3 and 7 had a high mean attitude rating 
of between Agree and Strongly agree. Since 
there is already a very favourable attitude 
towards these items, there is a need to change 
them for more critical issues where there is 
expected divergent attitudes. 

2. The items bordering on Uncertain to Disagree 
or Agree will be !rept as they are significant 
in terms of progroume objectives and goals. 

Note: The item numbers mentioned above refer to those 
item numbers which were used in the instrument 
developed for trial phase. 
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Questionnaire in Population Education 
for Non-Formal Education (NFE) Teachers/Tutors 

Name (optional) Age Sex 

Marital status Number of children ~ 

School 

Highest education completed 



Sources of information on population/family plan- 
ning and related information. Check (J) those that apply 
to you. 

□ School 

□ Radio 

□ Television 
I I Newspaper 

□ Magazine 

□ Comic books 

□ Films 

I I Pamphlets 

□ Village leaders 

O Doctors/nurses/midwives 

□ Neighbours/friends 

□ Own children who are schooling 

□ Others (Please specify) 



Knowledge 

Directions: Encircle the letter of the correct answer 
to each of the items below, 

1, What is your understanding of rapid population 
growth (RPG)? 

a) Many people migrate to the cities, 

b) Many babies are born every day* 

c) Couples are marrying early, 

d) Many babies are born but few people die, 

2, A head count of the population that is taken period- 
ically is called a 

a) registration 

b) census 

c) poll 

d) demographic survey 

9 V 
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When is a woman likely to be most fertile? 

a) During her menstrual period. 

b) At midpoint between menstrual periods. 

c) 3-4 days before menstruation. 

d) 3-4 days after menstruation. 

What will likely happen if there is a heavy in- 
migration o one area? 

a) The age structure of that area will become 

younger. 

b) It will have more resources. 

c) The value of land will decrease. 

d) There will be more oid people. 

What contraceptive method works on the physiological 
process of suppression of ovulation? 

a) pill 

b) IUD 

c) rhythm 

d) cream and jellies 

Which of the following statements correctly defines 
rhe concept of dependency burden? 

a) The number of non-working children in a family. 

b) The ratio of the working population to the total 

population. 

c) The ratio of the working population to the young 

and aged population. 

d) The percentage of the unemployed population. 

Which of the following phrases defines the concept 
of "completed family size"? 

a) The total number of living children born to a 

woman during her reproductive period. 

b) The total number of children born to a woman, 

including still births. 

c) The total number of members in the nuclear fam- 

ily - father, mother and children. 

d) The number of children ever born to a woman, 

including those who have died after birth. 
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In which of these characteristics would adult 
learners differ most from pupils? 

a) Literacy level 

b) Novelty of learning 

c) Motivation to learn new things 

d) Immediate application of most things learned 

Which of the following tasks would be the first 
ideal step to take when organizing a class for adult 
learners? 

a) Write the curriculum. 

b) Assess their learning needs. 

c) Recruit adults to enrol in the class. 

d) Collect/prepare instructional and other 

materials . 

A non-formal education lesson on "Values Held by 
People on Family Size" is best taught using 

a) Film showing 

b) Lecture by a resource perso.i 

c) Role playing 

d) Indoctrination 

The national population programme js promoting the 
message of delayed or late marriage for this reason: 

a) to enable young people to finish their 

schooling. 

b) to limit family size. 

c) to have more mature and responsible parents. 

d) to develop a sense of commitment among young 

people to a national problem. 

What does the broad base of a population structure 
mean? 

a) The population is stable. 

b) There are roany young people in the population. 

c) There are more people who die in their adulthood. 

d) There is likely to be high infant mortality. 

What is the relation of breatfeeding to fertility? 

a) Improves the health of the mother. 

b) Delays ovulation. 

c) Prevents conception. 

d) Decreases sex drive. 
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14, There are seven children in the Reyes family. The 
Santos family has three children. Both families 
have the same income and are about equal in other 
things. Which family is likely to be more healthy? 

a) Reyes family. 

b) Santos family. 

c) Both families. 

d) It is not possible to say. 

15. Who are the most greatly affected in terms of de- 
creased mortality when improved health services 
are introduced to a country? 

a) Old people. 

b) School-aged population. 

c) Infants. 

d) Young adults. 

Attitude Test 

Read careful! v the statements numbered 1 to 10. 
Below each statement, you will find five responses, 
name ly : 

SA - Strongly agree 

A * Agree 

U =» Undecided 

D 3 Disagree 
SD « Strongly disagree 

In respect of each statement, put a cross (X) mark 
on the appropriate place in each row to describe your 
agreement or disagreement. 

1. Couples should be free to have the number of children 
they desire . 

SA A 0 D SD 

2. The first child in the family should be male. 




SA A U D SD 

It is difficult to integrate population education 
in NFE programmes. 



SA A U D SD 
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4. A large family is a happy family. 

SA A 0 D SD 

5. The ideal age of marriage for both men and women 
should be 25 years. 

SA A 0 ~ D SD 

6. A good approach to introduce population education 
to the learners of NFE is through integration with 
other subjects in NFE programmes. 

SA A — U D SD 

7. Many NFE teachers are not willing to teach popula- 
tion because some of its contents are controversial • 

SA A U D SD 

8. If people continue to have large families, the 
problem of unemployment would become worse. 

SA A U D SD 

9. Fewer number of children will improve the quality 
of nutrition of family members. 

SA A 0 D SD 

10. Movement of people from the village to tho cities 
results in insufficient educational facilities for 
in-migrant children. 

SA ~A ~ U ~D SD 
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Skills 

A. Please encircle the appropriate number to indicate 
how much help you feel you need for each of the 
following tasks: 

5 = Very much 

4 = Much 

3 ■ Moderately 

2 » Little 

1 = Not at all 

1. Diagnosing /assessing 
learners 1 needs in popula- 
tion education in terms of 
knoweldge attitudes and 
practices/skills. 

2. Selecting appropriate con- 
tent to meet learners 1 
needs. 

3. Identifying points of entry 
for population education 
concepts/topics in NFE pro- 
grammes. 

4. Selecting and using exist- 
ing instructional materials. 

5 . Preparing/adapting 
instrucitonal materials. 

6. Rererring clients to 
appropriate agencies for 
needed services. 5 



5 4 3 2 1 

5 4 3 2 1 

5 4 3 2 1 

5 4 3 2 1 

5 4 3 2 1 
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B. Check (J) the frequency with which you use each of 
the following teaching methods/strategies according 
to the scale below: 

5 - Very often 

4 = Often 

3 * Sometimes 

2 ■ Rarely 

1 ■ Never 



Teaching methods strategies 


Frequency of use 




4 


3 


2 


1 1 


1 Lor t~ i i 

-»- • Lev. LUL C 












2. Small group discussion 












3. Role playing 












4. Demonstration teaching 












5. Film showing 












6. Brainstorming 












7. Debate 












8. Panel discussion 












9. Confrontation 












10. Field trip 












11. Others (please specify) 
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Please encircle the appropriate number to describe 
the extent of frequency of your use of each of the 
following evaluation approaches/techniques: 

1 - Never 

2 » Rarely 

3 - Sometimes 

4 ■ Often 

5 - Very often 



1. Knowledge te ,ts 



12 3 4 5 



2. Attitude rating scales 12 3 4 5 



3. Observation 

4. Interview 

5. Questionnaire 

6. Self-reports 



1 2 3 4 5 

1 2 3 3 b 

1 2 3 4 5 

1 2 3 4 5 



7. Others (please specify) 12 3 4 5 

1 2 3 4 5 

_ 1 2 3 4 5 

1 2 3 4 5 
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A. Planning phase 

1. Determine sample 

2. Design questionnaire 

3. Orient supervisors and researchers 

4. Pretest questionnaire 

5. Revise/finalize questionnaire 

6. Print required number of copies 

7. Identify and orient NFE trainers for both groups 

8. Assemble needed mater *2ls/modules for training 

9. Plan schedule of training with NFE trainers 

3. In piemen tat ion phase 

1 • Administer pretest 

2. Conduct training programmes (4) 

3. Administer post-test 

4. Check and record KAS scores 

5. Code data 

6. Check for consistency 

7. Tabulate da^s 
Analysis phase 

1. Analyze data 

2. Write research report 

K Reporting phase 

1. Print report 

2. Di -eminate . eport 

3. Preseni findings to appropriate audiences in 

conferences 
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May 



June 



Jul 



Aug 



Sept 



Oct 



Nov 



Dec 



*V/ork schedule chart gives an indication of time allocation 
for completing different activities of the study. 
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Quasi-Experimental Design 

Title: Effects of a Non-Formal Population Education 

Programme on the Knowledge of and Attitude To- 
wards Responsible Parenthood and Family Planning 
of Adults Attending Literacy Classes i;> Com- 
munity X. 

Rationale . Several developing countries in the 
Asian region which are characterized by rapid rates of 
population growth and low literacy rates have initiated 
non-formal population education programmes in recent 
years. The purpose of these programmes is to create 
awareness of population-related issues and quality of 
life concepts among the out-of -school youth and adults. 
Such awareness in turn is expected to break traditional 
resistance to population control and create ir.ore favour- 
able attitudes towards responsible parenthood and adop- 
tion of family planning. 

The task that the non-formal population education 
programme has to achieve ir formidable, as a large pro- 
portion of the population ±s illiterate. In many in- 
stances, population education content has to be inte- 
grated into the adult literacy and functional education 
programmes. Large sums of money have to be spent in 
organizing the programme, in the training of teachers, 
>velopment of training manual, preparation of the con- 
tent and implementing the programme. Hence, the need 
for evaluating their impact on the clientele. Taking 
as an example a small community "X" with an estimated 
population of about 50,000, the ' esent study is designed 
to illustrate the various steps involved in the evaluation 
of a non-formal population education programme. 

The setting . In the census taken in 1980 in Com- 
munity M X ft , the community was characterized by high popu- 
lation growth rates, i.e. about 3 per cent per year. 
Over the past two decades, the population has been in- 
creasing very rapidly due to natural increase as well 
as in-migration from the surrounding 'communities. If 
the growth rate continues, the population of this com- 
munity shall double in two decades or so. 
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As a result of socio-economic problems which are 
already felt and which could get worse, the community 
leaders have been convinced that along with the develop- 
ment of the resources, a population planning programme 
for the community js essential. The leaders are aware 
that the low literacy level of the population in general, 
and of the adult population in particular, and the tra- 
ditional pro-natalist attitudes and values existing in 
the community will be obstacles to the population plan- 
ning programme. Hence, a non-formal population educa- 
tion programme appears urgent. 

An adult literacy campaign has been started In 
the community to offer a functional literacy course 
extending over six months for the age group 18 years 
and above. One hundred adult literacy centres in both 
rural and urban areas have been opened. 

A Team of population education experts has been 
invited by the community leaderj to provide advice on 
the incorporation of population education concepts into 
the functional literacy curriculum. The recommendations 
of the Team include inter alia the introduction of non- 
formal population education and provision of family plan- 
ning services. Following such recommendations, a non- 
formal population education programme has been worked 
out with the help of local experts to introduce popula- 
tion education as part of the adult literacy classes. 

The population education programme has been con- 
ceptualized to: 

1. create awareness of population-related prob- 
lems in the community; 

2. develop an understanding of the relationship 
of population and the quality of life of the 
community; and 

3. develop awareness and positive attitudes to- 
wards responsible parenthood and family plan- 
ning. 

As an initial step, the training of a group of 
teachers in population education has been undertaken 
and a core; curriculum in population education developed 
for use in a selected number of the adult literacy centres. 
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Teachers' guides were also prepared for the course. 
These materials are focused on the core messages of popu 
lation education, namely; (i) community population, 
(ii) family size and fami-y welfare, (iii) delayed mar- 
riage, (iv) responsible parenthood, and (v) population 
and development. 

Objectives of the study 

1. To study the effects of population education 
integrated into functional literacy classes 

on the knowledge of adults attending the func- 
tional literacy classes. 

2. To assess the effects of population education 
on attitudes towards responsible parenthood 
and family planning. 

Conceptual framework . While an experimental study 
design would be ideal, it "is anticipated that a true 
experimental set-up with randomization, as well as having 
control and experimental groups, will not be feasible. 
As an approximation, the quasi-experimental non-equiva- 
lent group design has been selected and is illustrated 
below: 



Group exposed to both 

population education 0^ X 0 2 

and adult literacy. 

Group exposed only to q 
adult-literacy. 3 



The main independent variable in the study is popu- 
lation education integrated in literacy programme; the 
antecedent variables are age, sex, marital status, occu- 
pation, years of urban/rural residence, age at marriage, 
number of children and extent of attendance in class 
which will be obtained from the record of the Adult 
Literacy classes. Knowledge of the community's popula- 
tion problems, quality of life issues, knowledge of fam- 
ily planning and attitudes towards responsible parent- 
hood and family planning will be the dependent variables. 



9 

ERIC 



98 

106 



Some samp les 



Research hypotheses 

1. Upon completion of the six-month course, the 
level of knowledge and awareness of population 
and quality of life issues of those adult 
literates attending an integrated course of 
literacy and non-formal population education 
will be different from that of adults who are 
only attending the literacy course, 

2. After the completion of the six-month course, 
the attitudes towards responsible parenthood 
and family planning of the participants in 
the integrated literacy and non-formal popula- 
tion education course will be different from 
the participants of literacy course only. 

Methods and procedures 

Sample . Ten adult literacy centres (six from rural 
and four from urban areas) constituting 10 per cent of 
all centres will be randomly selected from the list of 
the 100 centres for introduction of the population edu- 
cation contents in the functions literacy curriculum 
to be taught by trained teachers. A similar number of 
centres from both the rural and urban airis will consti- 
tute the control groups. On the average, each class 
will consist of 25 participants. Hence, 250 subjects 
in the treatment group *nd 250 in the control group will 
constitute the sample, i.e. approximately 1^ per cent 
of the total participants in each group. 

Duration of treatment . The various population 
concepts and information on population and quality of 
lif • responsible parenthood and family planning will 
be incorporated in the appropriate sections of the lit- 
eracy curriculum and will be taught for a period of six 
months. For the convenience of the adult participants, 
the teaching sessions will be held in the late after- 
noons or evenings for one hour a day. Thus, the total 
teaching hours in the six months shall be 144. Allowing 
for absenteeism, the average time of exposure of parti- 
cipants to che programme is expected to be about 100 
hours • 
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A record ot actual attendance will be maintained 
to be used as one of the controls in the analysis of 
data. Before the start of the teaching sessions a pre- 
test will be given to the participants in the ten selec- 
ted centres who are to be exposed to population educa- 
tion, as well as those constituting the control group. 
A post-test will be administered to all participants of 
both the treatment and control groups immediately at the 
end of the six-month course. 

Instrument and administration 

1. An information file for each participant will 
be maintained in the Adult Literacy Centres 
giving general information on the participants 
demogrephic and socio-economic characteristics 

2. An interview schedule will be prepared for 
both the pretest and the post-test. The infor 
mation o n knowledge, perception and awareness 
will be collected through interviews by a 
group of ten interviewers who shall be trained 
by the project co-ordinator . Interviews shall 
be conducted with participants of both the 
treatment and control groups. Detailed in- 
structions on each item included in the ques- 
tionnaire will be given in the Manual of In- 
structions to Interviewers. Ten to 15 inter- 
views are expected to be completed in a day 

so that each interviewer shall be able to in- 
terview 50 participants in two adult literacy 
centres. The post-course interviews (both 
individual and group) will be conducted im- 
mediately at the end of the course, after the 
participants would have been exposed to an 
average of 100 hours of teaching on the popu- 
lation contents integrated in the literacy 
course. 

Teachers who shall be engaged to inter- 
view shall be paid on the basis of the number 
of interviews completed, both before and afte 
the treatment. Preferably the same inter- 
viewers will be engaged for the ore- and post 
programme interviews. 
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Limitation of the desifl n. This evaluative research 
design on a non-formal population education programme 
for adults is based on a hypothetical community to illus- 
trate the procedures involved in conducting such a study. 

The non-formal population education programmes 
of various countries will have to alter the design in 
the light of their unique socio-cultural contexts and 
needs. The selection of sample and type of questions 
included in the instruments have to be adapted and made 
relevant to the actual conditions prevailing in differ- 
ent countries. 

It is hoped, however, that the model presented 
will provide guidelines for designing evaluative studies 
to assess the effects of imparting population education 
as integrated in non-formal and/or literacy programmes. 

Instrumentation . In preparing the research instru- 
ments, a table of specifications was used (Table 12). 
Likewise, after the expeimental trial-use, the research 
instruments were revised accordingly. Thi revised re- 
search instruments are attached. 



Table 12, Specifications 



Area/concept 



Knowledge 



Attitude 



Demographic and social 
characteristics . 



6, 7, 8, 9, 
10, 11, 12, 
13, 14, 15, 
16, 18 



1, 2, 3, A, 5, 



Responsible parent- 
hood and family 
planning. 



26, 28, 29 
30-1, 30-11 



22a, 22b, 
22c, 31, 
32 



Population education 
and other concerns. 



17, 19, 20 
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Instrument' Interview Schedule 

Identification Sheet 
Location of centre: Urban □ Rural □ 

Name of village: - — 

Address: — 



I . funeral Information about the Respondent 



1. Name 

2 . Age : 



16-20 - 


□ 


21-25 - 




26-30 - 


□ 


31-35 - 


□ 


36-40 - 


a 


41-45 - 


□ 


46-50 - 


□ 


51-55 - 




56 and 


□ 


above 



3. Sex: Male □ Female □ 

4. Marital status: Never married □ 

Currently married □ 
Widowed 

Separated/divorced □ 

5. Age at first marriage: years 

(NOT APPLICABLE FOR 1H0SE NEVER MARRIED.) 

6. Number of children: 

Number of boys: 

Number of girls: . 

7. Your occupation: 



Occupation of your spouse 



8. Approximate family income per month: 

9. Have you had any previous schooling? 

Yes □ No □ 



If yes, how many years? 
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10. Religion: 

11. Do you have a radio in your household? 

Yes □ No □ 

Do you have a television in your household? 
Yes □ No □ 

12. Years of rural/urban residence: 

Rural □ years Urban □ years 

te: The above identification sheet on each partici- 
pant will be maintained in the Adult Literacy 
Centre for both the pretest and post-test. 

. Awareness and Perception of Population Problems 

1. What is the approximate population of your 
community? 



2. Do you think your community is overcrowded/ 
over-populated? 

Yes □ No □ Don't know □ 

3. Approximately how many babies were born to 
your community in the past year? 

S3 many □ Many □ Few □ 
None O No idea □ 

4. How many people died in your community in the 
past, year? 

So many □ Many □ Few □ 
None [□ No idea □ 

5. (a) How many people have migrated into your 

community in the past year? 
So many □ Many □ Few I I 
None Q No idea d] 

(b) How about the number of people who 
migrated out of your community? 
So many □ Many □ Few □ 
None □ No idea □ 
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6. How adequate are the resources (food and other 
amenities of life) of your community for the 
population? 

Very adequate □ 
Adequate CD 
Inadequate □ 
Very inadequate □ 
Don't know □ 

7. How adequate is the income of an average family 
in your community? 

Very adequate □ 

Adequate CD 

Inadequate CD 

Very inadequate CD 

Don't know CD 

r ;. What will happen to the supply of food and 

other basic services in your community if there 
is a large increase in population? 



9. In your opinion which of the following measures 
would contribute greatly to the quality of life 
of the people in your community? 

planning family size 

having many children 

trial marriage 

creating more job opportunities 

delaying marriage 

providing more educational facilities 
~~~~ any other (please specify answer) 



III. Views/Ideas on Age at Marriage, Size of Family, 
Responsible Parenthood 

10. What do you think is the right age for marriage? 

a) for men? years 

b) for women? years 
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11. a) Do you think mothers should space the 
births of their children? 
Yes □ No a 

b) Why? 




(If yes) 



c) What do you think is the ideal spacing 
between births? years 

12. What in your opinion is the ideal number of 
children a couple should have in your community 
these days? 

□ 1 
C2 2 

□ 3 

□ 4 

□ 5 

□ more than 5 (please specify exact 
number) 

13. What is the number of children you consider 
ideal for your family? 

n i 

□ 2 

□ 3 

□ 4 

□ 5 

C3 more than 5 (please specify exact 
number) 

14. How many boys and how many girls is the ideal 
number for your family? 

boys 

girls 



1 1 it makes no difference 

15. What are the characteristics of responsible 
parents? 
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16 • When you see a family with many children, how 
do you feel? 



IV, Knowledge of and Attitudes Towards Family Planning 

17. Have you heard of family planning? 

Yes □ No □ 

18. If yes, what do you understand about family 
planning? 



19. a) Can you name some methods of family plan- 
ning? 

Yes □ No □ 

b) If yes, please name the methods* 



20. Some couples adopt measures of family planning 
to space their children. Do you approve of 
this? 

Approve □ Disapprove □ 

21. Some couples adopt measures of family plan- 
ning to limit their family size. Do you 
approve of this? 

Approve □ Disapprove □ 



Other relevant comments by the respondents. 
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BEST COPY AVAILAbLt 



Activities 



A. Planning p>asej 

1. Oeteraine saajple 

2. Oaslgn interview 
schedu la 

3. Recruit interviewers 
and supervisor 

4. Train interviewers 
and supervisors 

5. Pretest interview 
schadu la 

6. Revise schedule 

B. Iepleaentetlon phasa 

1. Conduct pratast 
interviews 

2. Conduct pott- tat t 
intarviaws 

3. Coda data from pra- 
tast interview 

4. Chect* for consis- 
tency 

3. Kay punch data 

6. Tabulate data f roe 
pretest 

7. Coda, check, punch 
and tabulate post - 
test -date 

C. Analysis phase 

1. Analyze date 

2. Write research 
report 

3. Oisseainate report 



First year 



Jan Feb 



Her Apr May Jun Jul Aug Sep Oct Nov Dec 



Second year 



Jan Fab Mar Apr May Jun Jul Aug Sap Oct Nov Oac 



O * schedule chart gives an 
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DATA ANALYSIS TECHNIQUES* 

After the evaluative information has been gath- 
ered, the next concern is how to summarize it and draw 
meanings from it. This is often referred to as the 
statistical treatment of the data. This means tabulat- 
ing, summarizing, interpreting and making inferences 
from the available information. 

The purposes of statistics are to: 

1. describe what is typical or average in a 
group; 

2. describe the spread or variability of a 
group; 

3. describe the relationship of two variables 
in a group; 

4. compare two or more groups; 

5. determine the probability of occurrence of 
a statistic purely by chance along; 

6. estimate the value of an unknown parameter; 
and 

7. estimate the level of confidence of a certain 
value or statistics. 

Measures of central tendency 

To describe a group in terms of what is average 
or typical, the mode, the median or the man can be 
used. The mode is the most frequently occurring value. 
The median is what characterizes the middle point of 
a distribution. The mean is the arithmetical average 
of the values of a variable. 

•Based on the lecture presentation of Dr. Milagros D. Ibe, Professor, 
College of Education, University of the Philippines, consultant of 
the Regional Training Workshop on Evaluative Research in Population 
Education in Manila, from 20 to 31 May 1985. 
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The mode is the measure of average used for vari- 
ables measured at the nominal level while the median 
is used to represent the average for a variable measured 
at the ordinal level. The mean is used to reflect the 
average of a distribution which uses measurement at the 
interval or ratio level. 

Measures of variation 

The distance (or difference) between the highest 
value and the lowest values in a distribution is called 
the range. It is the least technical measure of dis- 
persion or variability. For variables measured on the 
ordinal level, the average deviation and the inter- 
quartile range are used as measures of variability. 
The most technical measure of variability is the stan- 
dard deviation. It is applied when the level of mea- 
surement is either interval or ratio. At these two 
levels, mathematical formulas are used for finding the 
average and the standard deviation. 



M ean « Sum of all the values 
Number of cases 

M * X 

M - 



N 



Standard deviation « the square root of the 

average of the squared 
deviations from the mean. 



4^ 



For the standard deviation from a sample, the 
equivalent formula is: 

/ SX 2 - (EX) 2 

S - J L_ 

Y N-l 
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Table 13 gives a summary of the descriptive stat- 
istical procedures used at different levels of measure- 
ment • 

Table 13. Descriptive statistical procedures 



Scale 
of 




Measure of 


Distribution 


Average 0 j spers ion/Variabil ity 


V 
A 
R 
I 
A 
B 
L 
E 


Nominal F, % in each 
category 


Mode Index of 

dispersion 


Ordinal F, $ in each 
or position 


Median Interquartile 
range 


Interval F, % in each 
interval 


Mean Standard 
deviation 


Ratio F, S in each 
interval 


Mean Standard 
deviation 



Measures of relationship 

As in the case of measures to describe what is 
typical/average and the extent of variability of a group, 
the statistical procedures to measure relationships of 
paired variables depend on the level at which the vari- 
ables are measured. The Pearson correlation technique 
is used when both variables are measured at the interval 
level. The formula is: 

NSXY - d!X)(SY) 

r =■ i 

<^[NZX 2 - (BX) 2 ] [NEY 2 - (SY) 2 ] 

Where X and Y represent the two variables whose 
extent of relationship is being measured. 

N - the number of cases 

When both variables are continuous but measured 
at the ordinal level, the Spearman rank correlation 
technique is used. The formula is: 

6gd 2 



^s ' 1 - 

Where N 
d 
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N(N 2 - 1) 

» the number of cases 
» the difference between the ranks of 
corresponding scores 
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Chi square is used as an index of dependence be- 
tween two variables which are both measured at the nom- 
inal level. The chi square formula is: 

Chi square or X 2 - g(Q ~ E)2 



Where 0 ■ the observed frequency 
E = the expected frequency 

To obtain a coefficient of relationship the chi 
square is expressed as a phi (pronounded "phee") co- 
efficient by means of this formula: 



Where r^ = the phi coefficient of correlation 
N = the number of cases 
X 2 = the chi square value 

Comparison of two groups 

Two groups can be compared in terms of their means 
or their variances. 

These are the techniques often used to compare two 
groups : 

1. The t-test = this is a parametric technique 
used to compare the mean scores of two inde- 
pendent samples. The difference of the mean 
scores in relation to the standard error of 
the combined variance of the two sets of 
scores is taken as a t-ratio. The formula is: 

^1 ~ ^2 



\s[ (N x - 1) + S 2 (N 2 - 1) 



][ni n 2 ] 



N x + N 2 - 2 

Where and N 2 = the number of cases in groups 

1 and 2, respectively 

Si and S 2 = the standard deviations of 
groups 1 and 2 

Ml and M 2 = the mean scores of the two 
groups 

111 

ERIC 121 



Evaluative research in population education 



When N X 



* N2, the formula is written simply as: 
- M2 




■1 



A corresponding non-parametric test for comparing 
the scores of two independent samples is the Mann - 
Whitney U-test. 



When subjects/respondents are matched with each 
other (as in the case of twins, husband and wife dis- 
tributed across two samples) or matched with themselves 
as in the pretest - post-test situation where the same 
respondents take both tests, mean scores can be stat- 
istically analyzed for difference by means of the t-test 
for related samples. This statistical test looks into 
the diference between the means of the paired or matched 
samples in relation to the standard £1101 of th* dif- 
ference between scores. 

The t formula used is: 



Where D - mean difference 

SD - standard deviation of the difference 
N * number of corresponding pairs/matches 

Corresponding non-parametric tests of difference 
between two matched/related samples are (i) the sign 
test; and (ii) the Wilcoxon matched Pairs Signed Ranks 
test. 



Comparing related or matched samples 



Mean difference 



t 



Standard error of the difference 



D 



^ N 



12* 
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Examp le : 

Suppose the pretest-post-test scores on a knowledge 
test given to 12 students are as follows: 



Student 


Scores 
Pretest -Post -test 


uain 


Gains 
squared 


A 


2 7 


c 


I J 


B 


3 6 


*i 


Q 


c 


1 8 


7 


/i Q 


D 


0 3 


3 


9 


E 


5 5 


0 


0 


F 


4 3 


-1 


1 


G 


1 6 


5 


25 


H 


0 4 


4 


16 


T 

X. 


3 2 


-1 


1 


J 


2 7 


5 


25 


K 


4 7 


3 


9 


L 


1 5 


4 


16 


-otal 


26 63 


37 


185 



Sum of the pretest scores ■ 26 
Sum of the post-test scores » 63 
Sum of the gain scores » 37 



Mean gain — - 3.08 

The sum of the squar I gain scores * 185 
Standard deviation of the gain/difference scores: 



SD 



Hence: 

3.03 

t » 2.54 

4u 
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The critical t-value at the .05 probability level 
for 11 degrees of freedom is only 2.201. Our computed 
value for t is much higher than the tabular value; hence, 
we reject the hypotheses that the post-test scores are 
the same as the pretest scores. (See Annex III). 

Rejection of this null hypotheses means that there 
is a significant difference between the pretest and post- 
test scores. 



The sign test 

To use the sign test on the same data we note the 
direction of change in score from the pretest to the 
post-*.- St. We say when there is an increase and 
"-" when there is a decrease, if the pretest and post- 
test scores of an individual are exactly che same we 
sa> there is no change, and write zero. Hence, the sam 
data can be presented as follows: 





Score 


Charge 


Amount of 
change 


Student 


Pre 


Post 


A 


2 


7 




5 


B 


3 


6 




3 


C 


1 


8 




7 


D 


0 


3 




3 


E 


5 


5 


0 




F 


A 


3 




1 


G 


1 


6 




5 


H 


0 


4 




4 


I 


3 


2 




1 


J 


2 


7 




5 




4 


7 




3 


1 i 


1 


5 




4 



We see that: One did not change (0) 
9 changed positively (+) 
2 changed negatively (-) 



Therefore, out of the 11 who changed, two (2) 
changed in the negative direction. The binomial prob- 
ability of /ll\ based on the probability table is: 

W > , ^ . .033 
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This meaas that the observed phenomenon of 11 
changes, two in the negative direction, can happen purely 
by chance alone 33 times in ? ,000 events. This prob- 
ability is less likely than .05, hence, re say that the 
statistics is significant. Therefore, we reject the null 
hypothesis that there was no change from pretest to post- 
test. This is essentially the sujn test. 

Note, however, that the sign test only considered 
the direction (or sign) of the change, but not the amount 
of change. If we study the scores we find that not all 
the 11 "changes" changed in the same amount. Student C 
changed the most because his score increased by 7 points 
in the post-test. If we rank the 11 students in terms 
of their change scores (starting with the least change 
as rank 1) we note that the sum of the ranks of the nega- 
tive changes is 3 (two scores of negative 1 have ranks 
of 1.5 each). This s the Wilc.oxon t-value. It has a 
probability of occurrence of less than 1 in 1,000. Hence, 
we say that there is a significant change or gain from 
the pretest to the post-test; that is, the changes are 
very unlikely to have happened by chance or luck, but 
are due to something which happened between the two test- 
ing times. 

Hence, we see that alJ the three statistical tests 
[t-test, sign test and Wilcoxon (test)] results point to 
the fact that there is a significant difference between 
the pretest and the post-test. 

Certain statistical techniques are commonly appli- 
cable to a number of the evaluative designs presented 
in Chapter Two. For example, the t-test for related 
samples could be used to determine whether the difference 
between pretest and post-test mean scores is significant; 
the t-test for independent samples is appropriate for 
determining the significance of the difference between 
mean scores of an experimental group and a control group. 
The chi square test can be used to determine whether 
there is a significant relationship between two variables. 

Indices of the relationship between two variables 
ran be obtained through (i) Pearson's product-moment 
correlation coefficient; and (ii) Spearman's rank corre- 
lation coefficient. 
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In the following pages, these five statistical 
techniques are illustrated through hypothetical data 
accompanied by tabulated summaries of the application 
of the techniques. 

1. t-test for matched groups 

2. t-test for independent groups 

3. Spearman's rank correlation technique 

4. Pearson's product-moment correlation technique 

5. Chi square test. 

t-test for matched samples 

Presented on page 117 are data obtained from three 
groups taught by the innovative approach to in-service 
training of teachers of population education. (See the 
research problem on formal education: Quasi-experimental 
design) . 

The situation calls for the t-test for matched 
or related samples. The statistical test Is summarized 
in Table 14. 

Table 14. Test of significance of gains in knowledge 
of population concepts of three 
teacher training groups 



G r oup 


N 


Moan 


score 


Gain in 
scores 


SO of 
gain 


t- 

ratio 


Critical 
value at the 
•05 level 


Pretest 


Post-test 


I 


30 


4.30 


8.56 


4.26 


3.6 


6.48 


2.045 


II 


32 


3.60 


8.03 


4.40 


2.91 


8.54 


2.042 


III 


37 


3.95 


7.45 


3.50 


2.39 


8.80 


2.021 



Interpretation: 



1. From the above table, it is clear that the 
training programme is effective, with all 
groups showing very significant gains. 

2. Since there is consistency in the results 
from the three groups, it may be concluded 
that the training approach is effective. 
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Hypothetical raw data on pretest-post-test scores of 
three groups of in-service teacher exposed 
to an innovative approach 



Group I 


v IN = ; 


Group II 


(N - 32) 


Group III 


(N = 37) 


rre 


Post 


Pre 


Post 


Pre 


Post 


8 


10 


6 


14 


4 


12 


4 


12 


3 


9 


0 


6 


3 


9 


4 




0 


4 


2 


17 


4 


8 


5 


7 


6 


6 


1 


7 


3 


5 


4 


12 


0 


5 


4 


6 


1 


8 


3 


8 


3 


5 


2 


8 


8 


8 


5 


10 


0 


9 


3 


9 


2 


7 


4 


10 


2 


10 


2 


6 


5 


12 


1 


6 


1 


5 


8 


5 


4 


10 


4 


8 


4 


4 


5 


6 


4 


10 


10 


9 


7 


5 


5 


9 


0 


3 


^ 


4 


6 


10 


5 


7 


2 


8 


4 


4 


6 


12 


4 


10 


3 


6 


7 


12 


5 


16 


5 


5 


3 


10 


0 


4 


4 


8 


2 


4 


6 


15 


4 


5 


4 


8 


4 


10 


3 


6 


1 


7 


3 


8 


8 


6 


5 


8 


5 


9 


4 


9 


6 


7 


5 


5 


1 


4 


5 


10 




10 
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Table 15 gives a summary of the t-test of gains 
in knowledge of an experimental and a control group in 
a study using a pretest-post-test control group design. 
The situation also calls for a t-test for matched samples. 

Table 15. t-test of gain scores o n knowledge of 
family planning from pretest to post-test 



Group 


Mean score 




N 


Pre 


Post 


Gain 


SD 


t-ratio 


Experimental 


30 


6.00 


7.87 


1.87 


l,6 r ) 


6.23*** 


Control 


30 


5.10 


4.63 


-0,47 


0,77 


-3.36** 



*** - Significant at the .001 level 
** - Significant at the .01 level 

Both the control and experimental groups changed 
very significantly. The t-values obtained (-3.36 and 
6.23) are both highly significant. But whereas the ex- 
perimental group changed positively, the control group 
changed negatively. The changes noted are not likely 
to be due to chance variations. 

t-test for independent groups 

Table 16 summarizes the statistical test applied 
to the mean scores of two hypothetical groups (experimen- 
tal and control) on a knowledge test. The formula used 
for computing the t-ratio is: 

M]_ - M 2 



SD{ (N L - 1) + SD 2 ( 



n 2 - i)] [l + Li 

J [ N l N 2j 



Ni + N 2 - 2 

Where Mi and M 2 are the mean scores of two groups 
Ni and N 2 are the group sizes 
SDi and SD 2 are the standard deviations 

The critical value for t and the .05 level of sig- 
nificance for 58 degrees of freedom is 2.021. 
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Table 16. t-test of comparison between means of the 
control and experimental groups 





Group 


N 


Mean 


SD 


t-ratio 
(df = 58) 


Pretest : 


Experimental 
Control 


30 
30 


6.00 
5.10 


2.53 
2.47 


1.39 NS 


Post-test: 


Experimental 
Control 


30 
30 


7.87 
4.63 


1.76 
2.39 


5.98 *** 


Gain: 


Experimental 
Control 


30 
30 


1.87 
-0.47 


1.68 
0.77 


6.94 *** 



*** - Significant at the .001 level 
NS - Not significant 



The data in Table 16 indicate that the control 
and experimental groups did not differ significantly 
at the start of the experiment. In other words they 
were initially comparable. 

After the treatment, the experimental group scored 
significantly hjgher in the knowledge post-test. The 
mean gain score of the experimental group is also very 
significantly higher than that of the control group. 

The results lead to the rejection of the hypothesis 
that the iwo treatment groups do not differ. The data 
show that the experimental treatment is more effective 
than the treatment given to the control group. 

Spearman's rank correlation 

Table 17 illustrates how the Spearman rank corre- 
lation coefficient is obtained between two variables 
measured at least on the ordinal level. The variables 
are (i) knowledge of population concepts; and (ii) at- 
titude toward population education. 
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Table 17. Computation of the Spearman's rank 
correlation coefficient between population education 
attitude and knowledge scores 



jtuQcnc 


— 

Know- 
ledge 
score 


P ank i 
Rd 11 rv 


\ttitude 
score 


Ra nk 


Differ- 
ence 


d 2 


A 


8 


23.5 


2A 


A 


1 Q C 


o on 9 S 
jOU * Z J 


B 


10 


15.5 


20 


i o 
1U 


j.j 


JU • Z J 


C 


10 


15.5 


20 


10 


c c 

J • J 


in 9 s 

jU • Z J 


D 


11 


11.5 


28 


1 


1U • j 


iin 9 s 

11U • L J 


E 


9 


20 


19 


1A 


0 • u 


JO • uu 


F 


12 


8 


16 


z z . J 


1 A S 
— 14 • J 


910 9 S 

Z 1U • L J 


G 


10 


15.5 


1A 


O C R 


— 1U • u 


1 oo OO 
1UU . uu 


H 


8 


23.5 


1A 


0 C R 

1 J . J 


0 o 

— L , U 


A oo 
** . uu 


I 


12 


8 


12 


0 Q R 

1 O . J 


o o ^ 
-ZU • J 


A 90 9 S 
4Z U . £ J 


J 


10 


15.5 


20 


10 


c c 

J.J 


**0 9 S 

JU . Z J 


K 


10 


15.5 


18 


18 


0 ^ 
- Z.J 


A 9 5 
0 . Z J 


L 


12 


8.0 


25 


2 


0 • u 


7fc oo 
jO . UU 


M 


8 


23.5 


20 


10 


17 Q 
1 J • J 


1 R9 9 S 

X OZ . Z J 


N 


11 


11.5 


18 


18 


~ O.J 


A9 9 S 
1 Z . Z J 


0 


15 


2.5 


2A 


A 


" 1 . J 


9 9 5 
Z * Z J 


P 


6 


28 


21 


7 


0 1 f\ 

1 1 • U 


A A 1 O O 
441 . UU 


Q 


7 


26.5 


18 


18 


Q R 
O • J 


79 9 5 
/ Z * Z J 


R 


10 


15.5 


20 


10 


c c 
J • J 


lO 9 5 
JU . Z J 


S 


9 


20 


22 


6 


1 A O 
14 . U 


1 Qfi OO 
1"0 • UU 


T 


12 


8 


16 


22.5 


-1A . j 


o 1 o 9 5 
Z 1U • Z J 


U 


13 


A. 5 


2A 


A 


O Q 

U . j 


O 9 5 
U » Z J 


V 


15 


2.5 


19 


1A 


-11.5 


132.25 


w 


12 


A. 5 


12 


28.5 


-24.0 


576.00 


X 


8 


23.5 


12 


28.5 


- 5.0 


25.00 


Y 


17 


1 


18 


18 


-17.0 


289.00 


z 


9 


20 


15 


2A 


- A.O 


16.00 


a 


12 


8 


19 


1A 


- 6.0 


36.00 


b 


3 


29 


12 


28.5 


0.5 


0.25 


c 


2 


30 


18 


18 


12.0 


1AA.00 


d 


7 


26.5 


17 


21 


5.5 


30.25 



Id 2 = 3819.50 
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The formula for the Spearman's rank correlation 
coefficient (r s ) is: 



d 2 



N (N 2 - 1) 



Where d - difference between ranks of corres- 
ponding scores 

n » number of cases 

6 (381 9,5) 
HenCe ^ = 1 - 30 (899) 

r s = .1502 

The r s obtained is far below the critical value 
(r = ,3809) for 28 degrees of freedom. Hence, we cannot 
say that there is a relationship between the two vari- 
ables (knowledge and attitude), (See Annex IV), 



Pearson correlation coefficient 

In the ex post facto design described in Chapter 3 f 
the researcher proposes to identify correlates to teacher' 
attitudes and knowledge of population education on one 
hand, and selected teacher variables on the other hand. 
The situation calls for the Pearson product moment corre- 
lation technique. 

On the following page are some raw data dealing 
with some of the variables covered by the proposed study, 
Pearson correlation coefficients were computed from the 
data. The coefficients are summarized in Table 18, 

The research hypothesis is that there is a rela- 
tionship between the dependent variables and each inde- 
pendent variable. 
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Raw data on selected variables 



Variables (scaled) 


Pe 

SUD 


rcept ion 
Dort ivene 


of 

ss 


Test 
scores 


Res- 
pondent 
No. 




Educa- 


Teach- 


Admin- 


mun uy 


Other 


Know- 
ledge 


Atti- 


Age 


tional 
attain- 


ing 
experi- 


istra- 
tors 


tudi- 
nal 




ment 


ence 












1 


5 


2 


5 


3 


3 


3 


8 


40 




A 

u 


2 


5 


3 


3 


3 


2 


35 






2 


o 


1 


1 


1 


5 


45 


4 




6 


0 


2 


3 


1 


7 


45 


J 


2 


3 


0 


2 


2 


1 


11 


45 


A 
U 


A 

u 






1 


1 


1 


12 


60 


7 


4 


3 


5 


3 


4 


3 


1 


40 


« 

o 




2 


1 


3 


3 


2 


7 


48 


9 


5 


2 


5 


3 


2 


2 


8 


50 


10 


4 


3 




1 


2 


2 


A 
U 




11 


3 


3 


1 


1 


2 


2 


8 


35 


12 


1 


6 


1 


1 
i 


2 


2 


8 


65 


13 


2 


2 


2 


3 


3 


3 


10 


60 


14 


3 


3 


4 


1 


1 


2 


5 


30 


15 


1 


6 


1 


3 


5 


3 


7 


45 


16 


2 


2 


1 


4 


4 


4 


5 


35 


17 


4 


2 


5 


1 


2 


1 


5 


42 


18 


1 


6 


2 




4 


2 


11 


50 


19 


5 


2 


3 




1 


2 


6 


42 



Table 18. Summary of Pearson correlation 
coefficient between knowledge/attitudes and selected 
teacher vribles (N = 19) 



1 

Teacher variable 


Correlation (r; 
knowledge 


With 
attitude 


1. 


Age 


-0.19 


-0.41 


2. 


Teaching experience 


-0.25 


-0.49* 


3. 


Perceived support of 








a) administrator 


0.10 


0.62 




b) community 


0.08 


0.64** 




c) other teachers 


-0.35 


-0.48 



df - 17; critical r-value at .01 level * .455 

* - Significant at the .05 level 
** - Significant at the .01 level 
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Interpretation 

The knowledge scores are not significantly corre- 
lated with any of the teacher attributes studied. The 
sample size (19) and the fact that the teachers were 
all from one cohort of teacher trainees could be the 
reason for the low correlations. 

The attitude scores correlated significantly with 
perceived community support and negatively with teaching 
experience and other teachers* support. 

Chi square test 

Tables 19 and 20 and the corresponding chi square 
values obtained from them illustrate the test of rela- 
tionship/independence of two variables. 

Table 19 tests the relationship between location 
of school and the attitude of NFE teachers* attitudes 
toward population issues. 

Table 19, Chi square analysis of the relation 
between attitude towards population 
issues and location of school 

Attitudes score 



Location 
of school 


Low 


High 


Total 


Rural 


14 


4 


18 


Urban 


i 


11 


12 


Total 


15 


15 


30 



X 2 - t.94 (Significant at the .05 level) 

Critical value X 2 - 3.84 (p - .05) (See Annex V). 

Hi * There is a relationship between attitudes 
of teachers and location of the school 
where they teach. 

H 0 =■ There is no relationship between attitudes 
towards population issues and location of 
schools of NFE tutors/teachers. 
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Decision: Since the computed X 2 value is higher than 
the critical value we reject the null hypo- 
thesis. The NFE teachers/tutors in rural 
areas have less positive attitudes than those 
in urban areas as measured by the post-test. 

Below is a set-up for applying the chi square 
test applied to a 2 x 3 contingency table. This is 
followed by the computation for the chi square value. 

Table 20, Test of difference between the 
experimental and control groups 1 attitudes 
toward population education 

Post score 



Attitude 


Control 
group 


Experimental 
group 


Total 


Negative 


14 (11.5) 


9 (11.5) 


23 


Neutral 


4 (5,5) 


7 (5,5) 


11 


Positive 


12 (13,0) 


14 (13,0) 


26 


Total 


30 


30 


60 



_ gO - E) 2 
X " E 

_ (14-11. 5) 2 + (9-11.5) 2 + (4-5. 5) 2 + (7-5. 5) 2 
X = 11.5 11-5 5.5 5.5 

+ (12-13) 2 + (14-13) 2 
13 13 

(+2.5) 2 + (-2.5) 2 + (-1.5) 2 + (+1.5) 2 
11.5 11.5 5.5 5.5 

+ (-1) 2 + (D2 
13 13 

= 0.54 + 0.54 + 0.41 + 0.41 + 0.08 

+ 0.08 - 2.06 

X 2 = 2.06 NS 

Critical X 2 (2 df) - 5.99; p = .05 
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H 0 - There is no difference in the attitudes to- 
wards population education of NFE teachers/ 
tutors trained in the self -instructional 
modality and those trained through the 
face-to-face modality. 

Hi - There is a significant difference in the 
attitudes towards population education of 
NFE teachers/tutors trained in the self- 
instructional modality and those trained 
through the face-to-face modality. 

Decision: Accept the null hypothesis (H 0 ) since the 

computed X 2 value (2.06) is much lower than 
the tabular value of 5.99 at the .05 level. 
In other words, we cannot say that the two 
modalities differ significantly in their 
effects on teachers attitudes. 

Summary 

There are many more statistical techniques, which 
one could be used in evaluative research. Only the more 
basic analysis techniques were included in this Manual. 
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GUIDELINES FOR WRITING AN EVALUATIVE RESEARCH REPORT 

The guidelines set out here are intended to be 
suggestive rather than definitive, and will need to be 
changed as appropriate in the light of the particular 
evaluative research that is being reported. 

The report should have a title that indicates as 
meaningfully as possible what the evaluative research 
is about. The report should contain the following 
major sections . 



1. 


Introduction 


2. 


Rationale 


3. 


Objectives 


4. 


Conceptual framework 


5. 


Hypthesis /hypotheses 


6. 


Research design and sampling procedure 


7. 


The collection of data 


8. 


The analysis of data 


9. 


Conclusions and recommendations 


10. 


Annexes 



Brief guidelines are given below for writing 
each section followed by a short note regarding the 
annexes • 

Introduction 

As the evaluative research is carried out to 
arrive at a decision regarding some aspects of a pro- 
gramme about to be undertaken or in the process of 
being implemented or that has been completed, an account 
should be given of the problem for which the programme 
is envisaged as contributing to a solution. The long- 
term goal of the programme and its specific objectives 
should be stated as envisioned. A few details as to 
who would be the clientele for the intervention, and 
the nature of the intervention should be provided. 
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The intent of such an account is to place the evalu- 
ation research study in context, and it should be writ- 
ten concisely and selectively. What follows below re- 
lates to the reporting of the research itself. 

Rationale 

The rationale for the research should be stated 
in order to explain why it is being undertaken. In 
addition, the problem addressed to by the study may 
also be stated in this section. Limitations on the 
scope of the research may also be pointed out. 

Objectives 

Here the specific objective(s) of the research 
should be stated. Objectives are statements about what 
the researcher wishes to find out or determine. 

Conceptual framework 

The conceptual framework of the research should 
be indicated. This refers to the relationships between 
the dxfferent concepts/constructs to be studied. 

Hypothesis/hypotheses 

The hypothesis /hypotheses to be tested in the 
research should be stared. If uy previous studies 
or insights from the documentation of the programme 
or any other programmes led to the formulation of these 
particular hypotheses, a brief account should be given 
before the hypotheses themselves are set out. 

Hypotheses are tentative answers to the problems 
or objectives of the studies. 

Research design and sampling proced ures 

An account should be given of the research design 
and the reasons for the choice of the particular design, 
especially if it is one of the relatively weak ones. 
The variables (independent, dependent) should also be 
specified. Possible confounding factors that were 
foreseen may also be mentioned here. 
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Full particulars should be given of the sampling 
method used for selecting the respondents. In some 
cases, there may be more than one category of respon- 
dents and if so the way in which each category was 
selected should be given. In order to give the composi- 
tion of the sample, two or three of the more important 
tables giving the demographic data may be included here, 
while stating the identification numbers of tables in 
the second annex that provide other kinds of demographic 
data • 

The collection of data 

A full description should be given of the proce- 
dure adopted for the collection of data. The extent 
to which documentation (e.g. reports) is used and the 
nature of the information collected should be indicated. 
There should be a complete description of the instru- 
ments (tests, attitude scales, rating scales, interview 
schedules, proformae for observation, etc.) used in the 
research. If any instruments that were already existing 
were used, an account should be given of the condition 
under which they had been developed and used. In the 
case of instruments specially devised for the research, 
a full description should be given of the way in which 
they were developed. The table(s) of specifications 
prepared and used in order to ensure that the tests 
items, etc. in the instruments cover comprehensively 
the major thrusts of the intervention should be incor- 
porated, and the distribution of items among the various 
components should be indicated on the table(s) of speci- 
fications. Steps taken for obtaining qualitative judg- 
ments regarding the instruments should be described. 

An account should be given of the sample and the 
procedure followed for the trial administration of the 
instruments. Item analysis data (e.g. indices of dis- 
crimination, ease/facility) should be provided in tables 
in an annex, and the availability of each instrument 
as a whole should be indicated when this is possible. 
Action taken to revise the instruments on the basis 
of the trial administration should Le described, and 
the major differences between the trial version and 
the final version should be indicated. The instruments 
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used in the final administration should be given as 
another annex with the following data for each: instruc- 
tions for administration, correct responses (where ap- 
plicable), marking scheme and reliability (when possi- 
ble). A description should be given of the procedu 
followed for the final administration of the instruments, 
e.g. who administered, to whom and how. If any persons 
other than the chief researcher were involved in data 
collection (e.g. for interviews, making observations, 
etc.); the action taken to train them should be de- 
scribed. The time schedule according to which the vari- 
ous activities were undertaken should be included in 
the first annex. 

The analysis of dat a 

The data derived from instruments may consist 
of some information that has to be analyzed on a quali- 
tative basis, and which cannot be transferred to tables. 
The principal findings from the qualitative analysis 
of such data should be stated. Some of the data would 
be transferred to tables. Not all the data transferred 
to tables will lend themselves to statistical analysis 
and what is possible is to record them. But in the 
case of some data transferred to tables, statistical 
analysis will be possible. All the data transferred 
as above to tables should be incorporated as an annex. 
Where statistical analysis is possible, it should be 
carried out and the particular statistical test indi- 
cated beneath the table with an indication regarding 
its significance at the 5 per cent level. The findings 
based on the statistical analysis should be in the 
annex. 

Conclusions and recommendations 

In this section, attention should be drawn to 
the principal findings of the research, taking care 
to point out any reservations that should be boine in 
mind in accepting them. The recommendations that follow 
from the findings should also be stated. 
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Note 

The time schedule for the various activities of 
the research can be given as Annex I. Annex II can 
contain the tables with demographic data, other than 
those already included in the body of the report. Item 
analysis data from the trial administration can be 
contained in Annex III. Annex IV should contain the 
test instruments with the following data for each; in- 
structions for administration, correct responses (where 
applicable), marking scheme, the coefficient of reli- 
ability (where applicable), and any other information 
considered useful. Annex V should contain all the re- 
maining tables, and where statistical analysis has been 
carried out details regarding the tests applied and 
the results, etc. should be given. 
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COST-EFFECTIVENESS OF 
POPULATION EDUCATION ACTIVITIES* 



Cost-effectiveness (CE) analysis refers to the 
evaluation of alternatives according to both their costs 
and their effects with regard to producing some outcome 
or set of outcomes (e.g. test scores). Often, in popu- 
lation education projects, an evaluation and decisions 
must be made on the choice of alternative approaches 
to meet a particular objective, e.g. providing a know- 
ledge base in population and population education for 
teachers. Many times, a decision on an approach must 
be based on a consideration of costs. For example, it 
may be too costly for all teachers to be called into 
the provincial centres to participate in a two-week 
training workshop. Hence, alternative methods must be 
devised to meet a particular objective which can be ac- 
complished within the limits of the budget available. 
A CE analysis combines measures of effectiveness with 
all alternatives in relation to their costs. Both the 
costs and effects of alternatives are taken into account 
in evaluating materials, methods, programmes, etc. with 
similar goals. It is assumed that (i) only programmes 
with similar or identical goals can be compared; and 
(ii) a common measure of effectiveness can be used to 
assess them. These effectiveness data can than be com- 
bined with costs in order to provide a cost-effectiveness 
evaluation that will enable the selection of those ap- 
proaches which provide the maximum effectiveness per 
level of cost or which require the least cost per level 
of effectiveness. 

Evaluative research and cost-effectiveness . Before 
any cost-effectiveness analysis can be made, it is first 
necessary to determine the programme objectives and an 
appropriate measure of effectiveness. For example, valid 
and reliable measures of effectiveness of alternative 

♦Based on Henry M. Levin, Cost-effectiveness: A primer. Beverly 
Hills/London/New Delhi: Sage Publications, 1983. 

131 



ERiC *4i 



Evaluative research in population education 



interventions, e.g. different methods of teaching on 
the learning of students and different modalities of 
training on enhancement of teaching competencies of popu- 
lation education teachers - may be determined through 
evaluative research. The standard evaluative research 
approaches already discussed in this workshop would be 
used for these measures of effectiveness, e.g. whether 
there are differences in learning in students using 
different methods (lecture, textbooks, participatory 
methods, etc.). In other words, the effectiveness of 
each instructional strategy as determined by rest scores 
of students in comparison with those of a control group 
would be used as a basis for determining "effectiveness". 
Below are some effectiveness measures in population 
education. 

Programme objectives Measures of effectiveness 

Student learning - Test scores 

Student attitudes - Attitude instruments 

Teacher training - Test scores 

- Observation of classroom 
behaviour 

Teacher attitudes - Attitude instruments, 

interviews 

Evaluative research studies can provide data on 
the effectiveness of various approaches, methods and 
strategies for achieving each objective. Hence, it is 
the starting point for a cost-effectiveness analysis. 

The costs of the various alternatives for meeting 
a particular objective are then assessed by determining 
the various inputs that they use and calculating their 
values. When the results of r.he effectiveness are com- 
bined with these costs, we can derive a cost-effective- 
ness ratio (C/E) that will show the relative costs for 
each measure of effectiveness. These results may show, 
for example, that the most "effective" approach is not 
always the most cost-effective. But without an analysis 
of costs, it would not be possible to know this. 

Concept of cost and ingredients . In a cost analy- 
sis we need to ascertain the cost of an intervention 
in terms of the value of the resources that were used 
or lost by applying them in one way rather than in another. 
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This is done by specifying: first, all of the ingredi- 
ents that are required for any particular intervention, 
e.g. personnel, equipment, materials, etc. Once these 
ingredients are specified, a value or cost estimate is 
placed on each of them. When the values of all the in- 
gredients are added, the total cost of the intervention 
is established. Furthermore, how the cost burden is 
distributed among funding sources can be ascertained. 

The identification and specification of ingredients 
is often facilitated by dividing the ingredients required 
into categories: 

1. Personnel (human resources, full and part- 
time) 

2. Facilities (offices, classroom, etc.) 

3 . Equipment and materials (books, typewriters , 
etc . ) 

4. Other programme inputs. 

5. Client inputs (own transportation, food). 

The ingredients should be specified in sufficient 
detail in order to allow a reasonably accurate cost 
estimate, especially the personnel component, which 
usually accounts for the largest contribution to the 
cost . 

Cost-effectiveness analysis: an example . Table 
21 represents a hypothetical set of cost-effectiveness 
results for a comparison of three different methods of 
in-service teacher training on the population knowledge 
acquisiton of teachers. Group A received training 
through a face-to-face workshop at a centre to which 
the participants travelled. Group B received training 
through self-learning modules on the same content, and 
Group C used a distance-learning method through radio 
and written workbook. The test scores were then compared 
statistically and the cost for each method was calculated 
by determining the various ingredients used and their 
values . 
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Table 21. Hypothetical cost-effectiveness 
results of different training methods 



Group 


Method 


Cost per 
Teacher voi 


Effectiveness (E) 
(Test scores) 


C/E 


A 


Face-to- face 


US$100 


40 


2.5 


B 


Self-learning 
module 


US$ 5 


30 


0.17 


C 


Distance 
learning 


USS 10 


10 


1.0 



The face-to-face approach shows a hypothetical 
cost of US$100 per teacher because of the high costs 
of the instructor, travel of participants, and per diem. 
The self-learning module and distance learning approaches 
required some travelling, but most of the cost was for 
the modules themselves. Personnel costs for _hese 
methods were low. The cost-effectiveness ratio, C/E 
was derived by dividing the cost per teacher for a one 
point improvement on the average in the test scores. 
While costs vary greatly from US$100 to US$5 (20-fold), 
the range of effectiveness is AO to 10 (4-fold). In 
addition, the face-to-face group would cost a hypotheti- 
cal US$2.50 a point to improve population education 
knowledge performance, the self-learning module method 
would cost only US$0.17 and the distance learning would 
cost US$1.00 in this hypothetical case. On this basis, 
the self-learning module method is most cost-effective, 
followed by distance learning. However, the most ef- 
ficient approach, when costs are ignored, ranks last 
in terms of costs, i.e. for US$100 per teacher, this 
method produced the highest test scores (most effective). 
But by spending one-fifteenth of the cost per teacher, 
the self-learning produced three-fourths of that effect. 

The use of cost-effectiveness analyses . The hypo- 
thetical example above tends to reflect the situation 
that is all too common in actual evaluations, in which 
the most "effective" approach is not always the most 
cost-effective. Yet, without an analysis of costs, it 
would be impossible to know this. Further, the adoption 
of the most "effective" alternative can actually cost 
many times as much as the most cost effective one. 
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While this kind of cost-effectiveness analysis 
is more likely to yield the types of information that 
are crucial to decisions on population education than 
when costs are ignored, it should not mean that these 
studies should be used mechanically to make decisions. 
There are always considerations that cannot be fully 
incorporated into the evaluations. For example, the per- 
sonal contact between a stimulating lecturer and teachers, 
especially in relation to developing attitudes may not 
reflected in test scores, but they may be extremely im- 
portant in population education, especially in motivating 
teachers to teach population education and developing 
a commitment to it. In addition, there may b3 organiz- 
ational or instructional factors that make one alterna- 
tive easier to implement than another. There may be 
cultural factors, e.g. those alternatives which are more 
similar to present approaches are more likely to provide 
predicted results over a longer term than those that 
represent a radical departure from existing practices. 
Thus, a consideration of only cost-effectiveness is in- 
appropriate. Rather, the results provide useful infor- 
mation that must be combined with other pertinent data 
and background in selecting alternatives. 

Conclusion 

Standard evaluation approaches to population edu- 
cation usually take account only of the effects of popu- 
lation education interventions. As population education 
expands and funds for it decline, policy decisions must 
be based on both costs and effectiveness of programmes. 
Cost-effectiveness analyses is one way of making it 
possible to choose those alternatives that provide the 
best results for any given resource or that minimize 
the resource utilization for any given outcome. 
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Annex III 
DISTRIBUTION OF t PROBABILITY 



df 


.1 


.05 


.01 


.001 


1 


6.314 


12.706 


63.657 


636.619 




2 ,920 


4 




T 1 soft 


3 


2.353 


3.182 


5.841 


12.941 


4 


2.132 


2.776 


4.604 


8.610 


5 


2.015 


2.571 


4.032 


6.859 


6 


1.943 


2.447 


3.707 


5.959 


7 


i one 
1 .895 




j ,«*yy 


■i AOS 


8 


1.860 


2.306 


3.355 


5.041 


9 


1.833 


2.262 


3.250 


4.781 


10 


1.812 


2.228 


3.169 


4.587 


11 


1.796 


2.201 


3.106 


4.437 


12 


1 TOO 

1 .78* 


i , i /y 


J ,\JJJ 


A ^Ift 


13 


1.771 


2.160 


3.012 


4.221 


14 


1.761 


2.145 


2.977 


4.140 


15 


1.753 


2.131 


2.947 


4.073 


16 


1.746 


2.120 


2.921 


4.015 


17 


1 .740 








18 


1.734 


2.101 


2.878 


3.922 


19 


1.729 


2.093 


2.eoi 


3.883 


20 


1.725 


2.086 


2.845 


3.850 


21 


1.721 


2.080 


2.831 


3.819 


22 


1.717 


2.074 


2.819 


3.792 


23 


1.714 


2.069 


2.807 


3.767 


24 


1.711 


2.064 


2.797 


3.745 


25 


1.708 


2.060 


2.787 


3.725 


26 


1.706 


2.056 


2.779 


3.707 


27 


1.703 


2.052 


2.771 


3.690 


28 


1.701 


2.048 


2.763 


3.674 


29 


1.699 


2.C45 


2.756 


3.659 


30 


1.697 


2.042 


2.750 


3.646 


40 


1.684 


2.021 


2.704 


3.551 


60 


1.671 


2.000 


2.660 


3.460 


120 


1.658 


1.980 


2.617 


3.373 


00 


1.645 


1.960 


2.576 


3.291 



Source: Annex III is abridged fron Table III of R.A. Fisher 
and F. Yates. Statistical Tables for Biological* Agricul- 
tural and Medical Research* published by Oliver and Boyd Ltd., 
Edinburgh. Abridged with permission of the authors and publisher. 
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VALUES jF r FOR DIFFERENT LEVELS OF SIGNIFICANCE 



df 


.1 


• 05 


• 02 


01 




1 


.98769 


.99692 


•999507 


.999877 


.9999988 


9 




.95000 


.98000 


.990000 


.99900 


T 

J 


,o054 


.8783 


.93433 


.95873 


.99116 


A 
4 


, /zvo 


.8114 


.8822 


.91720 


.97406 


K 




.7545 


• 8329 


.8745 


.95074 


6 


.6215 


.7067 


.7887 


.8343 


.92493 


/ 


con 


.6664 


.7498 


.7977 


.8982 


Q 
0 


R>1 Oil 
, >4^4 


,6319 


.7155 


.7646 


.8721 


Q 


. 14 




.6851 


.7348 


.8471 


lv 


/I07"* 
,4 V / J 


,3/OU 


.6581 


.7079 


.8233 


il 


.4762 


.5520 


.6339 


.6835 


.8010 


i ? 


>l R"7R 


• 5324 


.6120 


.6614 


.7800 


LJ 


,44Uy 


.5139 


.5923 


.6411 


.7603 


1 v4 
14 


,4^3y 


.4973 


.5742 


.6226 


.7420 




• 4 ll4 


.4821 


.5577 


.6055 


.7246 


16 


.4000 


.4683 


.5425 


.5897 


.7084 


17 


.3887 


.4555 


.5285 


.5751 


.6932 


18 


.3783 


.4438 


.5155 


.5614 


.6787 


19 


.3687 


.4329 


.5034 


.5487 


.6652 


20 


.3598 


.4227 


.4921 


.5368 


.6524 


25 


.323? 


.3809 


.4451 


.4869 


.5974 


30 


.2960 


.3494 


.4093 


.4487 


.5541 


35 


.2746 


.3246 


.3810 


.4182 


.5189 


40 


.2573 


.3044 


.3578 


.3932 


,4896 


45 


.2428 


.2875 


.3384 


.3721 


.4648 


50 


.2306 


.2732 


.3218 


.3541 


.4433 


60 


.2108 


.2500 


.2948 


.3248 


.4078 


70 


.1954 


.2319 


.2737 


.3017 


.3799 


80 


.1829 


.2172 


.2565 


.2830 


.3568 


90 


.1726 


.2050 


.2422 


.2673 


.3375 


100 


.1638 


.1946 


.2301 


.2540 


.3211 


Source: Annex 


IV is 


reprinted from 


Table VI of 


R.A. Fisher 



and F. Yates. Statistical Tables for Biological, Agricul- 
tural, and Medical Research, published by Oliver and Boyd Ltd., 
Edinburgh. Reprinted with permission of the authors and publishers. 
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Annex V 
DISTRIBUTION CF X a 



dt 


.99 


.98 


1 


.0*^157 


.0^26 


2 


.0201 


.0404 


3 


.115 


.185 


4 


.297 


.429 


5 


.554 


.752 


6 


.872 


1.134 


7 


1.239 


1.564 


8 


1.646 


2.032 


9 


2.088 


2.532 


10 


2.558 


3,059 


11 


3.053 


J.OW 


l 9 


3.571 


4.178 


13 


4.107 


4.765 


14 


4.660 


5.368 


15 


5.229 


5.985 


ID 


5 .612 


0 .0 14 


17 


6.408 


7.255 


18 


7.015 


7.906 


19 


7.633 


8.567 


20 


8.260 


9.237 


21 


8.897 


9.915 


22 


9. 542 


10.600 


23 


10.196 


11.293 


24 


10.656 


11.992 


25 


11.524 


12,697 


26 


12.196 


13.409 


27 


12.879 


14.125 


28 


13.565 


14.647 


29 


14.256 


15.574 


30 


14.953 


16.306 



Probability 

.95 .90 .80 .70 .50 .30 .20 .10 .05 .02 .01 .001 



.00393 .0158 .0642 .148 .455 1.074 1.642 2.706 3.841 5.412 6.635 10.827 

.103 .211 .446 .713 1.386 2.408 3.219 4.605 5.991 7.824 9.210 13.815 

.352 .584 1.005 1.424 2.366 3.665 4.642 6.251 7.815 9.P37 11.345 16.268 

.711 1.064 1.649 2.195 3.357 4.878 5.989 7.779 9.488 11.668 13.277 18.465 

1.145 1.610 2.343 3.000 4.351 6.064 7.289 9.236 11.070 13.388 15.066 20.517 

I. 635 2.204 3.070 3.828 5.348 7.231 8.558 10.645 12.592 15.033 16.812 22.457 
2.167 2.833 3.822 4.671 6.346 8.383 9.803 12.017 14.067 16.622 18.475 24.322 
2.733 3.490 4.594 5.527 7.344 9.524 11.030 13.362 15.507 18.168 20.090 26.125 
3.325 4.168 5.380 6.393 8.343 10.656 12.242 14.684 16.919 19.679 21.666 27.877 
3.940 4.865 6.179 7.267 9.342 11.781 13.442 15.987 18.307 21.161 23.209 29.588 

4.575 5.578 6.989 8.148 10.341 12.899 14.631 :/.275 19.675 22.618 24.725 31.264 

5.226 6.304 7.807 9.034 11.340 14.011 15.812 18.549 21.026 24.054 26.217 32.909 

5.892 7.042 8.634 9.926 12.340 15.119 16.965 19.812 22.362 25.472 27.688 34.528 

6.571 7.790 9.467 10.821 13.339 16.222 18.151 21.064 23.685 26.873 29.141 36.123 

7.261 8.547 10.307 11.721 14.339 17.322 19.311 22.307 24,996 28.259 30.578 37.697 

7.962 9.312 11.152 12.624 15.338 18.418 20.465 23.542 26.296 29.633 32.000 39.251 

8.672 10.085 12.002 13.531 16.338 19.511 21.615 24.769 27.587 30.995 33.409 40.790 

9.390 10.865 12.857 14.440 17.338 20.601 22.760 25.989 28.869 32.346 34.805 42.312 

10.117 11.651 13.716 15.352 18.338 21.689 23.900 27.204 30.144 33.687 36.191 43.820 

10.851 12.443 14.578 16.266 19.337 22.775 25.038 28.412 31.410 35.020 37.566 45.315 

II. 591 13.240 15.445 17.182 20.337 23.858 26.171 29.615 32.671 36.343 38.932 46.797 
12.338 14.041 16. 3M 18.10 1 21.337 24.939 27.301 30.813 33.924 37.659 40.289 48.268 
13.091 14.848 17.187 19.021 22.337 26.018 28.429 32.007 35.172 38.968 41.638 49.728 
13.848 15.659 18.062 19.943 23.337 27.096 29.553 33.196 36.415 40.270 42.980 51.179 
14.611 16.473 18.940 20.867 24.337 28.172 30.675 34.382 37.652 41.566 44.314 52.620 

15.379 17.292 19.820 21.792 25.33 29,246 31.795 35.563 38.885 42,856 45.642 54.052 

16.151 18.114 20.703 22.719 26.33c 30.319 32.912 36.741 40.113 44.140 46.963 55.476 

16.928 18.939 21.588 23.647 27.336 31.391 34.027 37.916 41.337 45.419 48.278 56.893 

17.708 19.768 22,475 24,577 28.336 32.461 35.139 39.087 42.557 46.693 49.588 58.302 

18.493 20.599 23.364 25.508 29.336 33.530 36.250 40.2 56 43.773 47.962 50.892 59.703 

Source: Annex V is reprinted from Table IV of R.A. Fisher and F, Yc.«»s. Statistical Tables for BxO 

logical, Ag >icultural> and Medical Research* published by Oliver and Boyd Ltd,, Edinburgh. Reprinted 

with permission of the authors and publishers. 
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